-- Logs begin at Mon 2022-08-08 00:10:20 UTC, end at Mon 2022-08-08 01:21:42 UTC. -- Aug 08 01:02:09.898473 dv-cinder-852261-1-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 08 01:02:09.907663 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Aug 8 01:02:09 2022] *** Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: nodename: dv-cinder-852261-1-iscsi Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: machine: x86_64 Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: clock source: unix Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: pcre jit disabled Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: detected number of CPU cores: 4 Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: current working directory: / Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: detected binary path: /usr/bin/uwsgi-core Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: your processes number limit is 47680 Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: your memory page size is 4096 bytes Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: detected max file descriptor number: 2048 Aug 08 01:02:09.909901 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: lock engine: pthread robust mutexes Aug 08 01:02:09.910825 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: thunder lock: enabled Aug 08 01:02:09.910825 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 08 01:02:09.910825 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 08 01:02:09.951824 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: Python main interpreter initialized at 0x5589a3e179c0 Aug 08 01:02:09.951824 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: python threads support enabled Aug 08 01:02:09.951824 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: your server socket listen backlog is limited to 100 connections Aug 08 01:02:09.951824 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: your mercy for graceful operations on workers is 90 seconds Aug 08 01:02:09.952195 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: mapped 403077 bytes (393 KB) for 2 cores Aug 08 01:02:09.952195 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: *** Operational MODE: preforking *** Aug 08 01:02:09.952504 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: *** uWSGI is running in multiple interpreter mode *** Aug 08 01:02:09.952504 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: spawned uWSGI master process (pid: 80308) Aug 08 01:02:09.952719 dv-cinder-852261-1-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 08 01:02:09.955176 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: spawned uWSGI worker 1 (pid: 80318, cores: 1) Aug 08 01:02:09.955176 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: spawned uWSGI worker 2 (pid: 80319, cores: 1) Aug 08 01:02:09.955176 dv-cinder-852261-1-iscsi devstack@keystone.service[80308]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 08 01:02:15.354256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 01:02:15.354256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: from cryptography.utils import int_from_bytes Aug 08 01:02:15.355107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 01:02:15.355107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes Aug 08 01:02:15.355107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 01:02:15.355107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: from cryptography.utils import int_from_bytes Aug 08 01:02:15.355613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 08 01:02:15.355613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: from cryptography.utils import int_from_bytes Aug 08 01:02:15.403635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 01:02:15.403815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 08 01:02:15.403895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 01:02:15.403971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 08 01:02:15.404038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] command line args: [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 01:02:15.404101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] command line args: [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 08 01:02:15.404231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 01:02:15.404376 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 08 01:02:15.404461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ================================================================================ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 01:02:15.404536 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ================================================================================ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 08 01:02:15.404761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.404902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] admin_token = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_dir = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config_dir = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405189 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] config_source = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] config_source = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] debug = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] debug = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.405718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407244 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_config_append = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_config_append = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_dir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.407949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408060 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408060 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_dir = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408298 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.408861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409336 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.409893 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410376 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410588 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.410892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.411014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.411299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.411442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.411531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] publish_errors = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.411609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.411742 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.411949 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.39/identity {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] publish_errors = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] standard_threads = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.412969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413372 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_journal = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_json = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.413856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_stderr = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.414005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.414101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] use_syslog = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.414321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.414442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] standard_threads = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.414557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.414654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.414812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.414936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.415027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.415108 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.415254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_journal = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.415386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.415465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_json = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.415536 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.415620 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_stderr = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.415718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.415806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] use_syslog = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.415990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.416122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 08 01:02:15.416201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.416382 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.416514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.416659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.416742 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.416912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.416999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.417197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.417278 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.417510 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.417591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.417801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.417923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.418126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.418247 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.418426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.418543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.418719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.418844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.419030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.419150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.419361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.419533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.419724 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.419921 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.420161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.420285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.420398 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.420545 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.420655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.420773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.420993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.421117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.421320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.421444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.421612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.421729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.421911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.422029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.422240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.422369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.422579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.422705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.422902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.423932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424609 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.424955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.425953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426199 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426733 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.426953 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.427954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.428928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429331 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429755 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.429969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.430124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.430243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.430470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.430620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.430736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.430856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.430968 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.431988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.432907 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433127 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.433917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.434933 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.435109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.435274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.435421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.435522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.435630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436264 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.436927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437037 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437148 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.437818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.438019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.438176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.438288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.438399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.438509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.438974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.439101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.439223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.439343 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.439527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.439651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.439763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.439880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440001 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440341 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.440950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.external = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441517 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.441955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.password = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] auth.token = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.442906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.external = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443571 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443695 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.443926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444037 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.password = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444148 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] auth.token = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444381 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.444925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445733 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.445957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446243 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446702 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.446924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447035 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.447954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.448966 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.449965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.450169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.450294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.450409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.450591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.450743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.450869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.450982 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451079 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.451945 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452057 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.452925 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453157 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453382 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.453960 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.454927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.455958 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.456986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457219 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457665 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.457900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458609 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.458946 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459178 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.459971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460424 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460657 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.460914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461605 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.461947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.462991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463104 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463337 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463558 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.463901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464237 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464804 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.464915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.465940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.466126 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.466283 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.466463 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.466648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.466843 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.466998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.467995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468437 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468660 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.468991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469311 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.469990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.470958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.471978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.472997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473333 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473675 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.473899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.474929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475040 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475152 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.475941 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.476848 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.477938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478067 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478841 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.478952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479063 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479063 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.479955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480407 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480746 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.480857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481680 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.481925 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482031 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482768 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.482996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483217 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483337 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.483853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484308 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484419 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.484872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.485080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.485080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.485288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.485288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.488874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489008 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489127 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.489939 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.490068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.490196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.490311 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.490424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.490868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.491481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.491619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.491743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.491858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.491970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.492888 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493001 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493344 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.493938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494112 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494696 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.494929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.495141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.495253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.495253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.495463 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.495585 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80319) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 01:02:15.495700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.495700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 08 01:02:15.495700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80318) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 08 01:02:15.518999 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.519200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.519439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.520035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.520260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.520484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.529294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.530477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.557518 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.557689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.558368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.558600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.609566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.609951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.659514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.659671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.659795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.659899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.723291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.723502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.723593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.723659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.723811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.723895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.723959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.724078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.724170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.724309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.724450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.724590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.747157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.747394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.747529 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.747666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.747840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.747966 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.748876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.759606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.759843 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.772345 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.772570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.772667 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.772815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.772931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80319) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.773885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80318) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 08 01:02:15.790924 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.791057 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.791195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 01:02:15.791275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 01:02:15.791457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.791602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.791739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 01:02:15.791820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 08 01:02:15.791940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.792011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.792137 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.792227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.792419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.792545 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.792680 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.792761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.804169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.804446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.804713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.804997 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.805155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.805432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.805699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.805982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.811993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.812994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.815404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.815689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.815963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.816242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.816365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.816494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.816666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.816760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.816922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817188 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817667 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.817938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.818093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.818210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.818501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.818776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.819040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.840796 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.842005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.842509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.842795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.843501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.843780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.847366 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.847646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.847926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.848352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.848634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.848915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.854473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.854756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.855581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.856015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.858905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.859195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.859482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.859771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.860052 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.860344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.860619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.860869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.863422 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.863941 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.864438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.864870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.865305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.865721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.865994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.866289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.876752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.877050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.881034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.882414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.882685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.884207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.884502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.886616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.889091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.889824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.890117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.892291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.894460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.895456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.895754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.896044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.896335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.896598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.896875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.897569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.900718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.901013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.901295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.901581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.901855 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.902165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.912892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.913142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.913409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.913678 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.918150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.918436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.918703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.918961 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.920525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.922107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.922416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.925211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.925502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.925776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.925903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.926042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.926323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.927354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.927634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.930439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.930719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.931006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.931301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.931573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.937882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.938187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.938465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.939088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.939365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.939637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.939909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.943306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.943581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.943857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.944129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.944388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.944658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.944930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.959500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.961477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.962425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.963993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.964409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.965474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.965744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.966108 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.967353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.968899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.970389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.970677 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.970948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.972449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.974040 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.976965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.977253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.977380 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.977539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.977827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.978871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.981833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.982395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.982395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.982601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.985845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.986136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.986440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.990696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.990980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.991255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.993553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80319) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.993841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.994145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.994422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.994693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.994972 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.995244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.995507 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.995894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.996175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.996447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.996690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.996967 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.997226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80319) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.998023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=80318) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 08 01:02:15.998323 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.998584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.998857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.999126 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.999402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.999670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:15.999933 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:16.000311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:16.000588 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:16.000855 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:16.001112 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:16.001385 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:16.001642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80318) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 08 01:02:16.030500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5589a3e179c0 pid: 80319 (default app) Aug 08 01:02:16.033789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab86a8-2b62-40e3-a9ec-afd8d5f9557e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:16.034091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab86a8-2b62-40e3-a9ec-afd8d5f9557e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:16.034371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeab86a8-2b62-40e3-a9ec-afd8d5f9557e None None] PATH_INFO: `/v3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:16.034760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x5589a3e179c0 pid: 80318 (default app) Aug 08 01:02:16.038698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 1/1] 10.222.0.39 () {50 vars in 791 bytes} [Mon Aug 8 01:02:16 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:23.663928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790677eb-5d86-4089-ba39-f6c4603bbb67 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:23.664533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790677eb-5d86-4089-ba39-f6c4603bbb67 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:23.664533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790677eb-5d86-4089-ba39-f6c4603bbb67 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:23.668872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 1/2] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:23.675545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:23.676349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:23.676465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:23.757805 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: INFO dbcounter [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] Registered counter for database keystone Aug 08 01:02:23.780150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG oslo_db.sqlalchemy.engines [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80319) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 01:02:23.791817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writer thread running {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 01:02:23.973800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80319) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 01:02:23.974266 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG passlib.handlers.bcrypt [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80319) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 01:02:24.029033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:24.030701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:24.179693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 2/3] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:23 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 506 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 01:02:24.361705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790677eb-5d86-4089-ba39-f6c4603bbb67 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:24.441211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: INFO dbcounter [None req-790677eb-5d86-4089-ba39-f6c4603bbb67 None None] Registered counter for database keystone Aug 08 01:02:24.465872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG oslo_db.sqlalchemy.engines [None req-790677eb-5d86-4089-ba39-f6c4603bbb67 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80318) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 08 01:02:24.473884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writer thread running {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 08 01:02:24.593126 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790677eb-5d86-4089-ba39-f6c4603bbb67 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:24.598655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a6e2a9-6dd4-48bb-ae60-8f8a2bf9a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:24.599274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e2a9-6dd4-48bb-ae60-8f8a2bf9a057 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:24.599548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e2a9-6dd4-48bb-ae60-8f8a2bf9a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:24.599814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a6e2a9-6dd4-48bb-ae60-8f8a2bf9a057 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:24.609022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6e2a9-6dd4-48bb-ae60-8f8a2bf9a057 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:24.660603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING keystone.common.rbac_enforcer.enforcer [None req-83a6e2a9-6dd4-48bb-ae60-8f8a2bf9a057 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 01:02:24.660872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a6e2a9-6dd4-48bb-ae60-8f8a2bf9a057 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:24.671423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 2/4] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Aug 8 01:02:24 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 01:02:24.678600 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:24.696320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c974dd-2f8a-4fad-9578-db0a0ccb41e7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:24.702775 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92474275-9360-444c-8717-38ca246eae9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:24.703909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92474275-9360-444c-8717-38ca246eae9a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:24.704212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92474275-9360-444c-8717-38ca246eae9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:24.704489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92474275-9360-444c-8717-38ca246eae9a admin admin] PATH_INFO: `/v3/projects/1076d8c1402c4204a0e2862514393b33` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:24.706175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92474275-9360-444c-8717-38ca246eae9a admin admin] RBAC: Authorizing `identity:get_project(project_id=1076d8c1402c4204a0e2862514393b33)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:24.756069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING keystone.common.rbac_enforcer.enforcer [None req-92474275-9360-444c-8717-38ca246eae9a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 08 01:02:24.756406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92474275-9360-444c-8717-38ca246eae9a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:24.761008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 3/5] 10.222.0.39 () {56 vars in 1207 bytes} [Mon Aug 8 01:02:24 2022] GET /identity/v3/projects/1076d8c1402c4204a0e2862514393b33 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:26.752155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc86227-50c0-4767-95fe-9db29b510115 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:26.752731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc86227-50c0-4767-95fe-9db29b510115 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:26.752731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc86227-50c0-4767-95fe-9db29b510115 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:26.756826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 3/6] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:26.763621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462218d9-1449-445f-b1e6-3b78b8e8bbdf None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:26.764276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462218d9-1449-445f-b1e6-3b78b8e8bbdf None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:26.764599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462218d9-1449-445f-b1e6-3b78b8e8bbdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:26.799029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-462218d9-1449-445f-b1e6-3b78b8e8bbdf None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:26.800604 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-462218d9-1449-445f-b1e6-3b78b8e8bbdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:26.809193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 4/7] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:26 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 08 01:02:26.831885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc86227-50c0-4767-95fe-9db29b510115 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:26.846456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc86227-50c0-4767-95fe-9db29b510115 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:26.851793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f170f6f-c110-4efc-9336-a3b123579470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:26.852389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f170f6f-c110-4efc-9336-a3b123579470 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:26.852666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f170f6f-c110-4efc-9336-a3b123579470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:26.852944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f170f6f-c110-4efc-9336-a3b123579470 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:26.861881 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f170f6f-c110-4efc-9336-a3b123579470 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:26.863704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f170f6f-c110-4efc-9336-a3b123579470 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:26.873184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 4/8] 10.222.0.39 () {58 vars in 1324 bytes} [Mon Aug 8 01:02:26 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 08 01:02:26.878865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462218d9-1449-445f-b1e6-3b78b8e8bbdf None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:26.888405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462218d9-1449-445f-b1e6-3b78b8e8bbdf None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:26.894325 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e925e-29ec-4206-af37-712614fbad94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:26.894950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e925e-29ec-4206-af37-712614fbad94 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:26.895230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e925e-29ec-4206-af37-712614fbad94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:26.895534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e925e-29ec-4206-af37-712614fbad94 admin admin] PATH_INFO: `/v3/users/cee3be3b33524c19a70d02b4d0135141` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:26.897016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e925e-29ec-4206-af37-712614fbad94 admin admin] RBAC: Authorizing `identity:get_user(user_id=cee3be3b33524c19a70d02b4d0135141)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:26.898916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e925e-29ec-4206-af37-712614fbad94 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:26.900450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 5/9] 10.222.0.39 () {56 vars in 1198 bytes} [Mon Aug 8 01:02:26 2022] GET /identity/v3/users/cee3be3b33524c19a70d02b4d0135141 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:28.943484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a745c-fb86-4060-bba0-32b160d17765 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:28.944034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a745c-fb86-4060-bba0-32b160d17765 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:28.944034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5a745c-fb86-4060-bba0-32b160d17765 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:28.945358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 5/10] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:28.950582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc652-a404-46d3-9cbc-ed7939bf908c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:28.951032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc652-a404-46d3-9cbc-ed7939bf908c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:28.951270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65cc652-a404-46d3-9cbc-ed7939bf908c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:28.960175 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282e1b-7e48-4ebb-a49b-89641411dc5a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:28.960462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282e1b-7e48-4ebb-a49b-89641411dc5a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:28.960774 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d282e1b-7e48-4ebb-a49b-89641411dc5a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:28.962022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 6/11] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:28.968919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:28.969197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:28.969471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:28.971831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b65cc652-a404-46d3-9cbc-ed7939bf908c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:28.973048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b65cc652-a404-46d3-9cbc-ed7939bf908c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:29.014065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG passlib.handlers.bcrypt [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80318) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 08 01:02:29.014504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG passlib.handlers.bcrypt [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80318) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 08 01:02:29.059405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:29.060765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 6/12] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:29.061104 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:29.084564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cc652-a404-46d3-9cbc-ed7939bf908c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.109327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:29.167915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 7/13] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:29.193075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.199160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65cc652-a404-46d3-9cbc-ed7939bf908c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.234475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.235115 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.235393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.235671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.246824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:29.256262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:29.257160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:29.257971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 7/14] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:29.263326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.302425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b4c19-1c26-4031-8f9b-fe1d2ea89d5a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.304854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:29.347383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.348232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.348490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.348844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.352779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:29.372785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b26876d-f300-4598-a7b7-794f585b61cd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.407484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.408092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.408367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.408645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.409312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:29.409611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:29.411060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:29.417051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:29.418642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:29.422451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 8/15] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:29.428004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.520027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 8/16] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:29.526039 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.529452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:29.639333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d5b692-f1f9-48a3-9c5d-6591741ae87c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.641114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a986086-b316-4bbc-bb51-f6f3f40ae15a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.672805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.673668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.673948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.674249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.674471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.675097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.675352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.675637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] PATH_INFO: `/v3/users/cee3be3b33524c19a70d02b4d0135141` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.676845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] RBAC: Authorizing `identity:get_user(user_id=cee3be3b33524c19a70d02b4d0135141)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:29.678328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:29.679871 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 9/17] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/users/cee3be3b33524c19a70d02b4d0135141 => generated 247 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:29.685385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.693864 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:29.695399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:29.700967 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:02:29.714645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:29.715712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:02:29.716765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:02:29.716765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:02:29.716765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:29.716765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 9/18] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:29.723126 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.778324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:29.796356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24894d1-603d-495c-be92-278c8f5cd55d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.821951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea20e-ecb7-4aa4-b76c-53796d8fcd0c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.833256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.833893 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.834209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.834480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.835615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:29.837071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:29.838661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 10/19] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:29.846101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:29.864992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d538d6-f17a-4280-9db4-f22f14509e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.865734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d538d6-f17a-4280-9db4-f22f14509e3c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.866013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d538d6-f17a-4280-9db4-f22f14509e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.866317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d538d6-f17a-4280-9db4-f22f14509e3c None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.866966 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d538d6-f17a-4280-9db4-f22f14509e3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:29.867262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d538d6-f17a-4280-9db4-f22f14509e3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:29.868654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d538d6-f17a-4280-9db4-f22f14509e3c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:29.885993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 10/20] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:29.935177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:29.957677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7268c59a-9a62-4f82-b2d4-7b76ea416a27 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:29.993778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8484014-5b08-4c07-962c-6491e982a288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:29.994439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484014-5b08-4c07-962c-6491e982a288 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:29.994722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484014-5b08-4c07-962c-6491e982a288 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:29.994972 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8484014-5b08-4c07-962c-6491e982a288 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:29.995743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8484014-5b08-4c07-962c-6491e982a288 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.domain.id=default, user.id=cee3be3b33524c19a70d02b4d0135141) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:29.996051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8484014-5b08-4c07-962c-6491e982a288 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:29.997524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8484014-5b08-4c07-962c-6491e982a288 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:30.005604 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 11/21] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Aug 8 01:02:29 2022] GET /identity/v3/role_assignments?user.id=cee3be3b33524c19a70d02b4d0135141&scope.domain.id=default&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 233 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:32.280920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3811e-c5c9-46f4-a86b-c24b6d666ebf None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.281447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3811e-c5c9-46f4-a86b-c24b6d666ebf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.281447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3811e-c5c9-46f4-a86b-c24b6d666ebf None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.282878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 11/22] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:32.292956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf363a4-45a0-4dae-bacb-84af486a3c30 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.293402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf363a4-45a0-4dae-bacb-84af486a3c30 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.293492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf363a4-45a0-4dae-bacb-84af486a3c30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.319088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1bf363a4-45a0-4dae-bacb-84af486a3c30 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:32.320297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1bf363a4-45a0-4dae-bacb-84af486a3c30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:32.413291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 12/23] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:32.446686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef52e1-a1e0-404f-a14b-0537e6798fb6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.446987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef52e1-a1e0-404f-a14b-0537e6798fb6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.447233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ef52e1-a1e0-404f-a14b-0537e6798fb6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.448580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 12/24] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:32.454220 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fccf-5605-4598-b27d-3cf9702d0a77 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.454516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fccf-5605-4598-b27d-3cf9702d0a77 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.454788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c141fccf-5605-4598-b27d-3cf9702d0a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.464986 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef52e1-a1e0-404f-a14b-0537e6798fb6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:32.479315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c141fccf-5605-4598-b27d-3cf9702d0a77 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:32.480580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c141fccf-5605-4598-b27d-3cf9702d0a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:32.568254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 13/25] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:32.592753 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141fccf-5605-4598-b27d-3cf9702d0a77 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:32.597140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:32.717361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ef52e1-a1e0-404f-a14b-0537e6798fb6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:32.746391 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:32.768681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe9626b-7f16-4041-8fa2-4fe165c30726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:32.769681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9626b-7f16-4041-8fa2-4fe165c30726 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.770190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9626b-7f16-4041-8fa2-4fe165c30726 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.770657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe9626b-7f16-4041-8fa2-4fe165c30726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.779029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c141fccf-5605-4598-b27d-3cf9702d0a77 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:32.781644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9626b-7f16-4041-8fa2-4fe165c30726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:32.783319 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe9626b-7f16-4041-8fa2-4fe165c30726 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8fe9626b-7f16-4041-8fa2-4fe165c30726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:02:32.800268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:32.801154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:02:32.801977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:02:32.801977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:02:32.801977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:32.803508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 13/26] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:02:32.807953 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26bdc-4c06-4426-8ab7-ea3d8a6af203 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.808450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26bdc-4c06-4426-8ab7-ea3d8a6af203 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.808913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c26bdc-4c06-4426-8ab7-ea3d8a6af203 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.811008 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 14/27] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:32.812490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3b5b-4dfb-4dbd-8682-79d7570135fe None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.812976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3b5b-4dfb-4dbd-8682-79d7570135fe None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.813450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c3b5b-4dfb-4dbd-8682-79d7570135fe None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.815477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 15/28] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:32.816530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3b5b-4dfb-4dbd-8682-79d7570135fe None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:32.834235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edf3a14-ddf0-4c72-afd4-bd83196d458f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:32.835388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3a14-ddf0-4c72-afd4-bd83196d458f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.835811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3a14-ddf0-4c72-afd4-bd83196d458f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.836216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edf3a14-ddf0-4c72-afd4-bd83196d458f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.849993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edf3a14-ddf0-4c72-afd4-bd83196d458f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3edf3a14-ddf0-4c72-afd4-bd83196d458f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:32.854932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:32.855776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:32.856545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:32.859156 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 14/29] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:02:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:02:32.860603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2233-9180-4a82-a8a1-0297c10e967e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.861087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2233-9180-4a82-a8a1-0297c10e967e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.861593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707a2233-9180-4a82-a8a1-0297c10e967e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:32.880648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-707a2233-9180-4a82-a8a1-0297c10e967e None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:32.882300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-707a2233-9180-4a82-a8a1-0297c10e967e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:32.943339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c3b5b-4dfb-4dbd-8682-79d7570135fe None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:32.948807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:32.966207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 15/30] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:32.968671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d423-206d-4d7e-99d0-9a7f19785394 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:32.969193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d423-206d-4d7e-99d0-9a7f19785394 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:32.969674 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d1d423-206d-4d7e-99d0-9a7f19785394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.006469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-32d1d423-206d-4d7e-99d0-9a7f19785394 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:33.008065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-32d1d423-206d-4d7e-99d0-9a7f19785394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:33.090182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 16/31] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:33.091437 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1d423-206d-4d7e-99d0-9a7f19785394 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:33.097912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:33.098616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.098900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.099171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.099819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:33.100121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:33.101608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:33.118097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 16/32] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:02:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:33.118097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:33.167499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:33.233851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d1d423-206d-4d7e-99d0-9a7f19785394 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:33.265328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:33.268674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3347e4-e6ed-426c-9716-9a477194aec1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:33.282212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:33.283136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.283617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.284191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.285151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:33.285640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:33.287452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:33.297487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 17/33] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:33.299336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:33.306286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:33.306912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.307191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.307461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.308135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:33.309506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:33.412192 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e1b3e-1a57-42dc-8091-5d6a6cb3b32c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:33.450812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:33.451553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.451880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.452159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.452820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:33.454338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:33.467996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 17/34] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Aug 8 01:02:33 2022] POST /identity/v3/roles => generated 225 bytes in 353 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:33.476106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:33.583692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:33.599253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f886e6-8de9-4f4c-b483-aecf1beba162 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:33.605387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 18/35] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:02:33 2022] POST /identity/v3/projects => generated 301 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:33.606791 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:33.671157 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51aa78d9-6b48-462b-aeda-8ef455c12f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:33.671808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa78d9-6b48-462b-aeda-8ef455c12f9a None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.672088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa78d9-6b48-462b-aeda-8ef455c12f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.672364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51aa78d9-6b48-462b-aeda-8ef455c12f9a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.673065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa78d9-6b48-462b-aeda-8ef455c12f9a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:33.675920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:33.676474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51aa78d9-6b48-462b-aeda-8ef455c12f9a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:33.700763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 18/36] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Aug 8 01:02:33 2022] POST /identity/v3/roles => generated 219 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:33.708002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422515eb-5b3d-4186-9419-ea6f36b73de6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.708002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422515eb-5b3d-4186-9419-ea6f36b73de6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.708306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422515eb-5b3d-4186-9419-ea6f36b73de6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.710143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 19/37] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:33.716627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01b5b-db89-488b-bc78-b8d0dc91daf6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.717029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01b5b-db89-488b-bc78-b8d0dc91daf6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.717297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac01b5b-db89-488b-bc78-b8d0dc91daf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.755338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bac01b5b-db89-488b-bc78-b8d0dc91daf6 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:33.756952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bac01b5b-db89-488b-bc78-b8d0dc91daf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:33.767646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4499ec08-4a58-458c-a6e8-ff3c70299c17 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:33.808669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079d92d1-9ac7-478a-8c62-730d3901c4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:33.809759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d92d1-9ac7-478a-8c62-730d3901c4fd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.810285 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d92d1-9ac7-478a-8c62-730d3901c4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.810939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079d92d1-9ac7-478a-8c62-730d3901c4fd None admin] PATH_INFO: `/v3/users/cee3be3b33524c19a70d02b4d0135141` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.812582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d92d1-9ac7-478a-8c62-730d3901c4fd None admin] RBAC: Authorizing `identity:get_user(user_id=cee3be3b33524c19a70d02b4d0135141)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:33.814862 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079d92d1-9ac7-478a-8c62-730d3901c4fd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:33.816795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 19/38] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:33 2022] GET /identity/v3/users/cee3be3b33524c19a70d02b4d0135141 => generated 247 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:33.818254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893626b-cb0d-4fcf-9709-c4fb8ee13a51 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.818742 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893626b-cb0d-4fcf-9709-c4fb8ee13a51 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.819147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4893626b-cb0d-4fcf-9709-c4fb8ee13a51 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.820564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 20/39] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:33.823025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893626b-cb0d-4fcf-9709-c4fb8ee13a51 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:33.864591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 20/40] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:33.866043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a387-e745-489b-ba05-ef46e6411890 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.867116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a387-e745-489b-ba05-ef46e6411890 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.867446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf63a387-e745-489b-ba05-ef46e6411890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.888353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cf63a387-e745-489b-ba05-ef46e6411890 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:33.891016 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cf63a387-e745-489b-ba05-ef46e6411890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:33.952396 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4893626b-cb0d-4fcf-9709-c4fb8ee13a51 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:33.960674 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:33.979783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 21/41] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:33.980640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63a387-e745-489b-ba05-ef46e6411890 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:33.993249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:33.993843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:33.994535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:33.994811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:33.995084 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:33.996412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:33.997952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:33.999998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 21/42] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:34.005942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:34.084981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf63a387-e745-489b-ba05-ef46e6411890 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:34.107198 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3391eda7-226f-45a3-85a7-052329615663 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:34.118594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:34.119135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:34.119430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:34.119720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:34.120353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:34.121745 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:34.136500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 22/43] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Aug 8 01:02:33 2022] POST /identity/v3/roles => generated 223 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:34.137307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:34.156193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:34.156984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:34.157262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:34.157707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] PATH_INFO: `/v3/domains/default/users/cee3be3b33524c19a70d02b4d0135141/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:34.159946 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cee3be3b33524c19a70d02b4d0135141, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:34.161678 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:34.180469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 22/44] 10.222.0.39 () {58 vars in 1361 bytes} [Mon Aug 8 01:02:34 2022] PUT /identity/v3/domains/default/users/cee3be3b33524c19a70d02b4d0135141/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:02:34.212730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:34.255591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c13bc4f5-0e03-462b-b2c0-ba27d2907c2b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:34.294416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f41b1c-d16e-4f04-bbe5-d5a7738987c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:34.295185 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f41b1c-d16e-4f04-bbe5-d5a7738987c8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:34.295467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f41b1c-d16e-4f04-bbe5-d5a7738987c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:34.295753 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f41b1c-d16e-4f04-bbe5-d5a7738987c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:34.297251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f41b1c-d16e-4f04-bbe5-d5a7738987c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:34.298791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f41b1c-d16e-4f04-bbe5-d5a7738987c8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:34.300735 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 23/45] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:34.306684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:34.347246 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:34.416595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065e5de-81a7-41b3-a52f-1e5814987c5f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:34.452039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05ef9a7-b35e-4520-ac7b-19e629651dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:34.452655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ef9a7-b35e-4520-ac7b-19e629651dc7 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:34.452942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ef9a7-b35e-4520-ac7b-19e629651dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:34.453209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05ef9a7-b35e-4520-ac7b-19e629651dc7 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:34.453867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ef9a7-b35e-4520-ac7b-19e629651dc7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:34.455374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05ef9a7-b35e-4520-ac7b-19e629651dc7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:34.483489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 23/46] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:02:34 2022] POST /identity/v3/projects => generated 312 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:36.179430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccf9f-24a4-4dcc-86f0-172cdddbdfb8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.179942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccf9f-24a4-4dcc-86f0-172cdddbdfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.179942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cccf9f-24a4-4dcc-86f0-172cdddbdfb8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.181494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 24/47] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:36.186589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc932-caf9-4e5a-89c8-56ffe2d45afd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.187035 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc932-caf9-4e5a-89c8-56ffe2d45afd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.187179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47fc932-caf9-4e5a-89c8-56ffe2d45afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.211722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b47fc932-caf9-4e5a-89c8-56ffe2d45afd None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:36.213391 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b47fc932-caf9-4e5a-89c8-56ffe2d45afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:36.282748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 24/48] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:36.307971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccf9f-24a4-4dcc-86f0-172cdddbdfb8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:36.408894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cccf9f-24a4-4dcc-86f0-172cdddbdfb8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:36.443174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:36.443802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.444082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.444356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.448267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:36.457530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:36.461435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174149-9ad7-4b1d-b8f4-2a9df6e3c477 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.461435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174149-9ad7-4b1d-b8f4-2a9df6e3c477 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.461435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50174149-9ad7-4b1d-b8f4-2a9df6e3c477 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.462502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 25/49] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:36.463535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:36.464598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:36.465451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 25/50] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:02:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:36.468405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f781e88-27bc-44e7-baba-f88e35fd9426 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.468693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f781e88-27bc-44e7-baba-f88e35fd9426 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.468968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f781e88-27bc-44e7-baba-f88e35fd9426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.470200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:36.488616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7f781e88-27bc-44e7-baba-f88e35fd9426 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:36.489811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7f781e88-27bc-44e7-baba-f88e35fd9426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:36.500716 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:36.560113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 26/51] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:36.570651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda673e9-b9bc-48eb-889b-95708bba7d94 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:36.584001 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f781e88-27bc-44e7-baba-f88e35fd9426 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:36.603646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:36.604255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.604532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.604804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.605475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:36.605816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:36.607206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:36.618780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 26/52] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:36.624535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:36.680886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:36.685662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f781e88-27bc-44e7-baba-f88e35fd9426 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:36.721274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:36.721904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.722212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.722398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21eb5e08-b218-41f2-9adc-0538a21b7908 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:36.722526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.723574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:36.725119 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:36.726721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 27/53] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:36.732463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:36.747375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:36.756845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:36.757486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.757773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.758085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] PATH_INFO: `/v3/users/cee3be3b33524c19a70d02b4d0135141` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.759460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] RBAC: Authorizing `identity:get_user(user_id=cee3be3b33524c19a70d02b4d0135141)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:36.760912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:36.762531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 27/54] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:36 2022] GET /identity/v3/users/cee3be3b33524c19a70d02b4d0135141 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:36.768083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:36.842603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94e7e6a-a3c6-4c01-9bd4-49db0a8a4591 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:36.874405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e71698-8c8d-40bf-a614-ebc89bbd27ca None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:36.876819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:36.877437 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.877717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.877988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.878664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:36.880134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:36.901547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:36.907891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 28/55] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Aug 8 01:02:36 2022] POST /identity/v3/projects => generated 298 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:02:36.911193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520c4d4a-a994-435c-baa5-d9a01ba2db2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:36.911845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c4d4a-a994-435c-baa5-d9a01ba2db2d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:36.912130 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c4d4a-a994-435c-baa5-d9a01ba2db2d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:36.912408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520c4d4a-a994-435c-baa5-d9a01ba2db2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:36.913551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c4d4a-a994-435c-baa5-d9a01ba2db2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:36.915090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-520c4d4a-a994-435c-baa5-d9a01ba2db2d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:36.916819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 28/56] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:36.923114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:36.992029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:37.030103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8ee8a1-c6d5-47c3-8739-ffced7e0704a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:37.066538 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53d3c5-0410-431c-a429-cdbb7afae98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:37.067282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53d3c5-0410-431c-a429-cdbb7afae98c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:37.067721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53d3c5-0410-431c-a429-cdbb7afae98c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:37.068118 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53d3c5-0410-431c-a429-cdbb7afae98c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:37.068924 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53d3c5-0410-431c-a429-cdbb7afae98c None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.domain.id=default, user.id=cee3be3b33524c19a70d02b4d0135141) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:37.069316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53d3c5-0410-431c-a429-cdbb7afae98c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:37.071264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53d3c5-0410-431c-a429-cdbb7afae98c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:37.078718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 29/57] 10.222.0.39 () {56 vars in 1322 bytes} [Mon Aug 8 01:02:36 2022] GET /identity/v3/role_assignments?user.id=cee3be3b33524c19a70d02b4d0135141&scope.domain.id=default&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 530 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:38.893533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983385d6-b274-48c7-8513-97d89aac59c4 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:38.894428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983385d6-b274-48c7-8513-97d89aac59c4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:38.894428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983385d6-b274-48c7-8513-97d89aac59c4 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:38.896666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 29/58] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:38.901950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd50f-d4a6-40f3-bc15-af0d1ac1a55b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:38.902473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd50f-d4a6-40f3-bc15-af0d1ac1a55b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:38.902473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4cd50f-d4a6-40f3-bc15-af0d1ac1a55b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:38.922157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8d4cd50f-d4a6-40f3-bc15-af0d1ac1a55b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:38.923338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8d4cd50f-d4a6-40f3-bc15-af0d1ac1a55b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:38.996828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 30/59] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:39.020536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983385d6-b274-48c7-8513-97d89aac59c4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:39.136724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983385d6-b274-48c7-8513-97d89aac59c4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:39.170679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42275fc7-b455-4063-912e-f16c05d77e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:39.171230 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275fc7-b455-4063-912e-f16c05d77e69 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:39.171512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275fc7-b455-4063-912e-f16c05d77e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:39.171780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42275fc7-b455-4063-912e-f16c05d77e69 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:39.172927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275fc7-b455-4063-912e-f16c05d77e69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:39.174509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42275fc7-b455-4063-912e-f16c05d77e69 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:39.176051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 30/60] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:39 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:39.182672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cd50f-d4a6-40f3-bc15-af0d1ac1a55b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:39.250560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:39.308070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4cd50f-d4a6-40f3-bc15-af0d1ac1a55b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:39.346450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a67a7-6123-43aa-97bb-a28eadcdb9ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:39.347051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a67a7-6123-43aa-97bb-a28eadcdb9ab None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:39.347329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a67a7-6123-43aa-97bb-a28eadcdb9ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:39.347602 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a67a7-6123-43aa-97bb-a28eadcdb9ab None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:39.348240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a67a7-6123-43aa-97bb-a28eadcdb9ab None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:39.349684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565a67a7-6123-43aa-97bb-a28eadcdb9ab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:39.379427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 31/61] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:02:39 2022] POST /identity/v3/users => generated 275 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:42.235868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fbf0a-4d05-44ab-b489-d1a1811d89d8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:42.236715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fbf0a-4d05-44ab-b489-d1a1811d89d8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:42.237159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1fbf0a-4d05-44ab-b489-d1a1811d89d8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:42.238670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 31/62] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:42.243771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502ee1-bdd5-4b58-bb2f-5951ad195b21 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:42.244486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502ee1-bdd5-4b58-bb2f-5951ad195b21 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:42.244896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67502ee1-bdd5-4b58-bb2f-5951ad195b21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:42.270989 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-67502ee1-bdd5-4b58-bb2f-5951ad195b21 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:42.272399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-67502ee1-bdd5-4b58-bb2f-5951ad195b21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:42.364328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 32/63] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:42.401990 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fbf0a-4d05-44ab-b489-d1a1811d89d8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:42.480313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:42.531836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1fbf0a-4d05-44ab-b489-d1a1811d89d8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:42.566295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb69c21-1349-4495-ae11-1afe2622fc8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:42.566929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb69c21-1349-4495-ae11-1afe2622fc8b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:42.567207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb69c21-1349-4495-ae11-1afe2622fc8b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:42.567473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb69c21-1349-4495-ae11-1afe2622fc8b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:42.578544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb69c21-1349-4495-ae11-1afe2622fc8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2eb69c21-1349-4495-ae11-1afe2622fc8b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:42.583234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:42.584058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:42.584808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 32/64] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:42.591959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502ee1-bdd5-4b58-bb2f-5951ad195b21 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:42.646672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:42.708744 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34c55-7fc3-4ede-a54f-8c2ab82cf06e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:42.709203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34c55-7fc3-4ede-a54f-8c2ab82cf06e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:42.709797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f34c55-7fc3-4ede-a54f-8c2ab82cf06e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:42.711353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 33/65] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:42.713424 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67502ee1-bdd5-4b58-bb2f-5951ad195b21 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:42.725776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad34adc-8c92-45de-a649-42579273b589 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:42.726365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad34adc-8c92-45de-a649-42579273b589 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:42.726852 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad34adc-8c92-45de-a649-42579273b589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:42.758608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8ad34adc-8c92-45de-a649-42579273b589 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:42.762246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8ad34adc-8c92-45de-a649-42579273b589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:42.782935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:42.783914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:42.784411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:42.784868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:42.785730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:42.786287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:42.787931 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:42.803891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 33/66] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:42.809549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:42.899508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 34/67] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:42.922376 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad34adc-8c92-45de-a649-42579273b589 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:42.973312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86e5932-1337-4f34-920d-7085acee203f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:42.987332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.014426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.021764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702f84fc-e812-4b36-b54b-6927610a6f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.022872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f84fc-e812-4b36-b54b-6927610a6f08 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.023298 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f84fc-e812-4b36-b54b-6927610a6f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.024120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702f84fc-e812-4b36-b54b-6927610a6f08 None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.042146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f84fc-e812-4b36-b54b-6927610a6f08 None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:43.043643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702f84fc-e812-4b36-b54b-6927610a6f08 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:43.045474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 34/68] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:42 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:43.046196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad34adc-8c92-45de-a649-42579273b589 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.051279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736bcc-cac9-434f-be2b-39c98d5ddb58 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.051574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736bcc-cac9-434f-be2b-39c98d5ddb58 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.051851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0736bcc-cac9-434f-be2b-39c98d5ddb58 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.053269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 35/69] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:43.054148 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5265c-2c5b-4ccf-b588-fcef214832ab None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.054435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5265c-2c5b-4ccf-b588-fcef214832ab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.054710 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5265c-2c5b-4ccf-b588-fcef214832ab None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.055948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 36/70] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:43.056649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5265c-2c5b-4ccf-b588-fcef214832ab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.089300 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25002afe-2d70-4dd1-a0d1-971a53aaec4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.089938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002afe-2d70-4dd1-a0d1-971a53aaec4b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.090272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002afe-2d70-4dd1-a0d1-971a53aaec4b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.090502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25002afe-2d70-4dd1-a0d1-971a53aaec4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.101781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25002afe-2d70-4dd1-a0d1-971a53aaec4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-25002afe-2d70-4dd1-a0d1-971a53aaec4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:43.106550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:43.107383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:43.108118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 35/71] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:02:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:02:43.114125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91377-8281-4c4c-9af5-c57819b955b2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.114592 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91377-8281-4c4c-9af5-c57819b955b2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.115013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea91377-8281-4c4c-9af5-c57819b955b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.133377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2ea91377-8281-4c4c-9af5-c57819b955b2 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:43.134645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2ea91377-8281-4c4c-9af5-c57819b955b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:43.181687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb5265c-2c5b-4ccf-b588-fcef214832ab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.203222 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 36/72] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:43.204777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96239bc4-528f-41bf-ae14-f6aa7e57f064 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.205069 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96239bc4-528f-41bf-ae14-f6aa7e57f064 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.205363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96239bc4-528f-41bf-ae14-f6aa7e57f064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.215923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96506ee4-d759-4a92-a02e-bbf3aae8100c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.216535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506ee4-d759-4a92-a02e-bbf3aae8100c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.216812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506ee4-d759-4a92-a02e-bbf3aae8100c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.217080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96506ee4-d759-4a92-a02e-bbf3aae8100c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.226651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-96239bc4-528f-41bf-ae14-f6aa7e57f064 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:43.227760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-96239bc4-528f-41bf-ae14-f6aa7e57f064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:43.249976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.263674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.285693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96506ee4-d759-4a92-a02e-bbf3aae8100c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:43.287215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96506ee4-d759-4a92-a02e-bbf3aae8100c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:43.295048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 37/73] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:43.295966 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96239bc4-528f-41bf-ae14-f6aa7e57f064 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.390167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 37/74] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:43.391504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9bee-0e3e-4200-8757-fba23b1357ca None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.391792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9bee-0e3e-4200-8757-fba23b1357ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.392062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f9bee-0e3e-4200-8757-fba23b1357ca None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.393448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 38/75] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:43.394036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9bee-0e3e-4200-8757-fba23b1357ca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.401216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96239bc4-528f-41bf-ae14-f6aa7e57f064 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.437955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.438605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.438888 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.439165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.440196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:43.440493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:43.441885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:43.454766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 38/76] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:43.454766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.467289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.485826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.504092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f9bee-0e3e-4200-8757-fba23b1357ca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.538160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.538794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.539074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.539344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.549738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:43.552038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6ff5f6-242d-46d5-ac2f-ea6b0881a69d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:43.554457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:43.555378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:43.556139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 39/77] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:43.556813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.590578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1705f751-b835-41b5-a9bc-2e5b7174698c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.591200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f751-b835-41b5-a9bc-2e5b7174698c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.591510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f751-b835-41b5-a9bc-2e5b7174698c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.591779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1705f751-b835-41b5-a9bc-2e5b7174698c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.602252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1705f751-b835-41b5-a9bc-2e5b7174698c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1705f751-b835-41b5-a9bc-2e5b7174698c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:43.607999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:43.608976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:43.609806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 39/78] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:43.616015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7986-f056-4fce-818d-b6a117d509f2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.616601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7986-f056-4fce-818d-b6a117d509f2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.616895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ae7986-f056-4fce-818d-b6a117d509f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.634968 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e9ae7986-f056-4fce-818d-b6a117d509f2 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:43.636167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e9ae7986-f056-4fce-818d-b6a117d509f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:43.662598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb509db-9889-4c04-a782-df4c5c8f8d36 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.690846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.700592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.701231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.701497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.701767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.702952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:43.704423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:43.705857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 40/79] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:43.706207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 40/80] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:43.706822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7986-f056-4fce-818d-b6a117d509f2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.713861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.731908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.804267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ae7986-f056-4fce-818d-b6a117d509f2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.821011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de425462-618d-4c95-8aef-e902e3916c30 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.836863 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.837494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.837768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.838034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] PATH_INFO: `/v3/users/cee3be3b33524c19a70d02b4d0135141` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.839205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] RBAC: Authorizing `identity:get_user(user_id=cee3be3b33524c19a70d02b4d0135141)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:43.840625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:43.842204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 41/81] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/users/cee3be3b33524c19a70d02b4d0135141 => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:43.846011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.857332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.857934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.858445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.858599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.859206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:43.859505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:43.860918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:43.869142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 41/82] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:43.869912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:43.926922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.934572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:43.944454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b05e472-0a56-417d-ae7b-27f06604a534 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.972482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf5fcc-db30-4034-9563-ee7895696da6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:43.978564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:43.979195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:43.979471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:43.979739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:43.980383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:43.980677 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:43.982045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:43.989990 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 42/83] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:43.990793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.009023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.009632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.009913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.010235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.010965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=4d5bc0e65035421b90d55b3b2e8b5ce6) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:44.011273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.012764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.018179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 42/84] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/role_assignments?user.id=4d5bc0e65035421b90d55b3b2e8b5ce6&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:44.018943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.115394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8ff91d-4645-4054-b168-63013cbcca69 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.135110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56460ee6-ea87-46c7-a01d-de78a51705fb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.155542 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.156274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.156550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.156823 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.158062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.158749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:44.159576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.161443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 43/85] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:44.162028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.179775 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.181316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.181316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.181316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.191102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:44.257928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.259865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.271807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a84140-cb2f-4c96-985e-66396c5a51a7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.306381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.307018 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.307298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.307556 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.308698 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.310255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.312414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 44/86] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:44 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:44.313198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.372972 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 43/87] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:44.373623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.395682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:44.417772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:44.431350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a19973f-a696-4c96-881e-83ccefe64563 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.470981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.471643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.471926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.472202 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.473366 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.474862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.478093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 45/88] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:44 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:44.478093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.487291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868c4d1-ea72-426f-ae36-6a45e980690b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.522953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.523564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.523840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.524110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.524753 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.526227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.549656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 44/89] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:02:44 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:44.563287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.598539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e593b284-5554-4265-8df7-e7a7c9478468 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.653678 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.654587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.655045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.655505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.659524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:44.687774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955d8574-6a40-4130-ba31-98ca85bb69a7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.700467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:44.736479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.737872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.738185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.738646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.739976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.742474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.745164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 45/90] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:44 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:44.745957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.751546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:44.753020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:44.878256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 46/91] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:44.879628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6169fca-8993-438f-a5bd-fdd0489b7efc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:44.882870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:44.924664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:44.925679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:44.925974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:44.926284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:44.950165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:44.970709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:45.038414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49048c-c9ed-4e82-a70e-e072ebd04294 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:45.040635 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:45.042158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:45.102771 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:45.103445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:45.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:45.104048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:45.104782 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=cee3be3b33524c19a70d02b4d0135141) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:45.105087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:45.110641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:45.125920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 47/92] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:44 2022] GET /identity/v3/role_assignments?user.id=cee3be3b33524c19a70d02b4d0135141&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:45.126872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:45.243043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 46/93] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:45.249893 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:45.315595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a59e87-0fc4-44d2-b7da-457aed06e8b6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:45.323747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:45.387711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:45.398175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e671df8c-be8c-4b26-a278-9835f6000057 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:45.432464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:45.433108 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:45.433392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:45.433737 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] PATH_INFO: `/v3/projects/cb4c65f878074a7f936eabe998169411` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:45.434972 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] RBAC: Authorizing `identity:get_project(project_id=cb4c65f878074a7f936eabe998169411)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:45.436614 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:45.436974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:45.437437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:45.437629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:45.437845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:45.438524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 47/94] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:45 2022] GET /identity/v3/projects/cb4c65f878074a7f936eabe998169411 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:45.441086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:45.442590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:45.444245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 48/95] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:45 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:45.444652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:45.450042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:45.600431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8a4a06-8f9f-4139-839b-657512e61a76 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:45.608692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8855b85c-c315-47da-9be9-c3b8fe766805 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:45.613996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:45.635403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b176b0f2-5295-489f-bfbb-8e41f1f5f66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:45.636116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b0f2-5295-489f-bfbb-8e41f1f5f66e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:45.636459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b0f2-5295-489f-bfbb-8e41f1f5f66e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:45.636820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b176b0f2-5295-489f-bfbb-8e41f1f5f66e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:45.637622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b0f2-5295-489f-bfbb-8e41f1f5f66e None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=cb4c65f878074a7f936eabe998169411, user.id=4d5bc0e65035421b90d55b3b2e8b5ce6) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:45.637991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b0f2-5295-489f-bfbb-8e41f1f5f66e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:45.639611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b176b0f2-5295-489f-bfbb-8e41f1f5f66e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:45.645267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 48/96] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:45 2022] GET /identity/v3/role_assignments?user.id=4d5bc0e65035421b90d55b3b2e8b5ce6&scope.project.id=cb4c65f878074a7f936eabe998169411&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:45.661495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8a49ec-ec6c-4ea7-ab46-ed9acd49191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:45.662295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a49ec-ec6c-4ea7-ab46-ed9acd49191b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:45.662668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a49ec-ec6c-4ea7-ab46-ed9acd49191b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:45.663055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8a49ec-ec6c-4ea7-ab46-ed9acd49191b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:45.663900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a49ec-ec6c-4ea7-ab46-ed9acd49191b None admin] RBAC: Adding query filter params (role.id=0167dcf165304e1390fd26c235128524, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=4d5bc0e65035421b90d55b3b2e8b5ce6) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:45.664307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a49ec-ec6c-4ea7-ab46-ed9acd49191b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:45.665885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8a49ec-ec6c-4ea7-ab46-ed9acd49191b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:45.672476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 49/97] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:45 2022] GET /identity/v3/role_assignments?user.id=4d5bc0e65035421b90d55b3b2e8b5ce6&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=0167dcf165304e1390fd26c235128524 => generated 259 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:46.633396 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bdbad-a05d-410e-8bd4-f1bdc7e05e6a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:46.633934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bdbad-a05d-410e-8bd4-f1bdc7e05e6a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:46.633934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84bdbad-a05d-410e-8bd4-f1bdc7e05e6a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:46.635152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 49/98] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:46.640851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a41c0-602e-439d-a051-89ee1fdc5bff None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:46.641251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a41c0-602e-439d-a051-89ee1fdc5bff None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:46.641414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11a41c0-602e-439d-a051-89ee1fdc5bff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:46.665865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d11a41c0-602e-439d-a051-89ee1fdc5bff None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:46.665865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d11a41c0-602e-439d-a051-89ee1fdc5bff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:46.729586 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:46.751670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 50/99] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:46.782558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bdbad-a05d-410e-8bd4-f1bdc7e05e6a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:46.885628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84bdbad-a05d-410e-8bd4-f1bdc7e05e6a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:46.919197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:46.919831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:46.920109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:46.920380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:46.930616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:46.935693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:46.936668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:46.938317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 50/100] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:46.947177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a41c0-602e-439d-a051-89ee1fdc5bff None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:47.077857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11a41c0-602e-439d-a051-89ee1fdc5bff None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:47.120008 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:47.120936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.120936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.121158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:47.121863 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:47.126454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:47.127853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:47.136629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 51/101] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:47.142414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:47.201993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:47.282346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa982a3-8ccf-4538-a191-8fb50d971009 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:47.322757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beade99-bcc7-446f-8bf7-8123ea4da3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:47.323463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beade99-bcc7-446f-8bf7-8123ea4da3ba None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.323747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beade99-bcc7-446f-8bf7-8123ea4da3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.324016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beade99-bcc7-446f-8bf7-8123ea4da3ba None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:47.325226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beade99-bcc7-446f-8bf7-8123ea4da3ba None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:47.326752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beade99-bcc7-446f-8bf7-8123ea4da3ba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:47.329105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 51/102] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:47 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:47.335072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:47.351736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664ea0-35f1-405f-9b29-f936cdabe3b8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.352408 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664ea0-35f1-405f-9b29-f936cdabe3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.352874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71664ea0-35f1-405f-9b29-f936cdabe3b8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:47.355687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 52/103] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:47.360906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb206-f2c0-4222-9373-2fa849f25954 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.361472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb206-f2c0-4222-9373-2fa849f25954 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.361937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6beb206-f2c0-4222-9373-2fa849f25954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:47.398220 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b6beb206-f2c0-4222-9373-2fa849f25954 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:47.399357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6beb206-f2c0-4222-9373-2fa849f25954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:47.447231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:47.477362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 53/104] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:47.500764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb206-f2c0-4222-9373-2fa849f25954 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:47.535372 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:47.554016 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27dee5-fdff-4344-bb4a-a8434ef31dc4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:47.590755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:47.591818 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.592288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.593020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:47.594882 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:47.596643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:47.599844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 52/105] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:47 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:47.607007 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:47.610252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6beb206-f2c0-4222-9373-2fa849f25954 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:47.648983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:47.649584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.649863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.650191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:47.662436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:47.667882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:47.668741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:47.669901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 54/106] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:47.675853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:47.786667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:47.790607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c155148c-bba2-4ff7-8acc-b4f4df862a95 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:47.831247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:47.831247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.831247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.831247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:47.832212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:47.832212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:47.832212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:47.841750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 55/107] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:47.848364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:47.920088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58221a1f-4751-4617-a549-eb92114f8a31 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:47.955163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:47.956692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3ff3dd-8611-44f7-8ec4-d7eb3841aa42 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:47.993895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:47.994698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:47.994990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:47.995269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] PATH_INFO: `/v3/users/dd7a2bc3b75245ea9cc7cf09107cd208` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.010025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] RBAC: Authorizing `identity:get_user(user_id=dd7a2bc3b75245ea9cc7cf09107cd208)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:48.011751 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:48.018335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 56/108] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:47 2022] GET /identity/v3/users/dd7a2bc3b75245ea9cc7cf09107cd208 => generated 289 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:48.019889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:48.042497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:48.047465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a233c65-f872-43e1-bde8-328f51add525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:48.048876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a233c65-f872-43e1-bde8-328f51add525 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.048876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a233c65-f872-43e1-bde8-328f51add525 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.049240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a233c65-f872-43e1-bde8-328f51add525 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891/users/4d5bc0e65035421b90d55b3b2e8b5ce6/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.053050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a233c65-f872-43e1-bde8-328f51add525 None admin] RBAC: Authorizing `identity:create_grant(project_id=5eed008ec382415094a2620db0a75891, user_id=4d5bc0e65035421b90d55b3b2e8b5ce6, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:48.054715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a233c65-f872-43e1-bde8-328f51add525 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:48.073405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 53/109] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:02:47 2022] PUT /identity/v3/projects/5eed008ec382415094a2620db0a75891/users/4d5bc0e65035421b90d55b3b2e8b5ce6/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:02:48.075149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743d3c-b0ad-4b15-9396-17b81464e9af None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.075617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743d3c-b0ad-4b15-9396-17b81464e9af None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.076028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39743d3c-b0ad-4b15-9396-17b81464e9af None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.078552 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 54/110] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:48.087374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a5514-5500-4123-9747-039be681c2e9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.087882 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a5514-5500-4123-9747-039be681c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.088296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a5514-5500-4123-9747-039be681c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.115412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b87a5514-5500-4123-9747-039be681c2e9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:48.122261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b87a5514-5500-4123-9747-039be681c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:48.202431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3aa537-62e8-448e-8b00-7e10273ee898 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:48.204980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 55/111] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:48.231310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a5514-5500-4123-9747-039be681c2e9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:48.245818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c88fe1-76a4-441b-ab75-deaec454347b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:48.245818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c88fe1-76a4-441b-ab75-deaec454347b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.245818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c88fe1-76a4-441b-ab75-deaec454347b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.245818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c88fe1-76a4-441b-ab75-deaec454347b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.329101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c88fe1-76a4-441b-ab75-deaec454347b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:48.331571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c88fe1-76a4-441b-ab75-deaec454347b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:48.350955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:48.369955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a5514-5500-4123-9747-039be681c2e9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:48.373218 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:48.428706 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03fe1a2-9190-4136-82be-3a9df0d2870b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:48.429292 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe1a2-9190-4136-82be-3a9df0d2870b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.429585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe1a2-9190-4136-82be-3a9df0d2870b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.429865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03fe1a2-9190-4136-82be-3a9df0d2870b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.444716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03fe1a2-9190-4136-82be-3a9df0d2870b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c03fe1a2-9190-4136-82be-3a9df0d2870b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:48.450820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:48.451661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:48.452937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 56/112] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:02:48.453796 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cfd10-a604-4c63-9922-0d7d62366a83 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.453981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cfd10-a604-4c63-9922-0d7d62366a83 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.454259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55cfd10-a604-4c63-9922-0d7d62366a83 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.455832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 57/113] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:48.458168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cfd10-a604-4c63-9922-0d7d62366a83 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:48.474336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 57/114] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 01:02:48.475993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8559-b376-42ac-aaf7-f3c434681f8f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.476288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8559-b376-42ac-aaf7-f3c434681f8f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.476569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10b8559-b376-42ac-aaf7-f3c434681f8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.510113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e10b8559-b376-42ac-aaf7-f3c434681f8f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:48.510999 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e10b8559-b376-42ac-aaf7-f3c434681f8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:48.592531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 58/115] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:48.598332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8559-b376-42ac-aaf7-f3c434681f8f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:48.666697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55cfd10-a604-4c63-9922-0d7d62366a83 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:48.666888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:48.738496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10b8559-b376-42ac-aaf7-f3c434681f8f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:48.771261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:48.771892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.772175 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.772451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.773143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:48.773450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:48.774868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:48.796893 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 58/116] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:48.797757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:48.806265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:48.806924 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.807204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.807727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.815971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:48.817472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:48.819341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 59/117] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:48.820172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:48.850484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:48.932314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaaeace-4637-4eb3-a49a-254b9aba2cdf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:48.936959 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec91827-0634-44d5-9325-88832f8a9858 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:48.947427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:48.970955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707b76fe-f95e-40bc-9520-7cc83f290962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:48.971693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b76fe-f95e-40bc-9520-7cc83f290962 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.972047 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b76fe-f95e-40bc-9520-7cc83f290962 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.972372 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:48.972501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707b76fe-f95e-40bc-9520-7cc83f290962 None admin] PATH_INFO: `/v3/users/cee3be3b33524c19a70d02b4d0135141` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.973009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.973286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.973557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.973762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b76fe-f95e-40bc-9520-7cc83f290962 None admin] RBAC: Authorizing `identity:get_user(user_id=cee3be3b33524c19a70d02b4d0135141)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:48.974818 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:48.975423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707b76fe-f95e-40bc-9520-7cc83f290962 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:48.976251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:48.977097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 60/118] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/users/cee3be3b33524c19a70d02b4d0135141 => generated 247 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:48.982937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 59/119] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:48.982937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:48.983135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d945f-a323-4ed0-8398-65b420714cc1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.983135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d945f-a323-4ed0-8398-65b420714cc1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.983135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d945f-a323-4ed0-8398-65b420714cc1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.984547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 61/120] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:48.985446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0c02-7c2f-45d2-a074-af0ad73c3181 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:48.985831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0c02-7c2f-45d2-a074-af0ad73c3181 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:48.986090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ce0c02-7c2f-45d2-a074-af0ad73c3181 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:48.987265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 62/121] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:48.987958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0c02-7c2f-45d2-a074-af0ad73c3181 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:49.082806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:49.091021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cabd85c-ca2e-43db-bfdf-5af7e6f66e10 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:49.101769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ce0c02-7c2f-45d2-a074-af0ad73c3181 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:49.133792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:49.134444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.134727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.135001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.135737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] RBAC: Adding query filter params (role.id=109c3809326c4439ae93c5f162b01640, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=dd7a2bc3b75245ea9cc7cf09107cd208) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:49.136053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:49.137527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:49.142443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7f9cd-c1cc-46b5-94f5-2787b3b0a616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:49.143207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 60/122] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/role_assignments?user.id=dd7a2bc3b75245ea9cc7cf09107cd208&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=109c3809326c4439ae93c5f162b01640 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:49.143514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f9cd-c1cc-46b5-94f5-2787b3b0a616 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.143918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f9cd-c1cc-46b5-94f5-2787b3b0a616 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.144013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:49.144464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7f9cd-c1cc-46b5-94f5-2787b3b0a616 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.155582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f9cd-c1cc-46b5-94f5-2787b3b0a616 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:49.157318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7f9cd-c1cc-46b5-94f5-2787b3b0a616 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:49.160592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 63/123] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:48 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:49.161983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d201f1-47b5-417c-a13f-5cf49be82f17 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.162362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d201f1-47b5-417c-a13f-5cf49be82f17 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.162640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d201f1-47b5-417c-a13f-5cf49be82f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.188383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-19d201f1-47b5-417c-a13f-5cf49be82f17 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:49.190304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-19d201f1-47b5-417c-a13f-5cf49be82f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:49.253596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:49.285460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 64/124] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:49.286176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b094bc8-9e5f-48b6-898c-b41b7e7ae336 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:49.286601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090130c9-23e0-40d7-becd-d34057b94e1e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.286888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090130c9-23e0-40d7-becd-d34057b94e1e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.287164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090130c9-23e0-40d7-becd-d34057b94e1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.315549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-090130c9-23e0-40d7-becd-d34057b94e1e None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:49.317460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-090130c9-23e0-40d7-becd-d34057b94e1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:49.331807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:49.332504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.332799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.333297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.334042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:49.335787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:49.378248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 61/125] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:02:49 2022] POST /identity/v3/projects => generated 302 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:49.379137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:49.409539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:49.430293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 65/126] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:49.432936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090130c9-23e0-40d7-becd-d34057b94e1e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:49.591424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffb027-6a2f-4ed3-b79b-f6dea321d67d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:49.616807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090130c9-23e0-40d7-becd-d34057b94e1e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:49.627386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:49.631760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:49.632720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.633198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.633763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891/users/cee3be3b33524c19a70d02b4d0135141/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.636107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] RBAC: Authorizing `identity:create_grant(project_id=5eed008ec382415094a2620db0a75891, user_id=cee3be3b33524c19a70d02b4d0135141, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:49.637604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:49.664931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 62/127] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:02:49 2022] PUT /identity/v3/projects/5eed008ec382415094a2620db0a75891/users/cee3be3b33524c19a70d02b4d0135141/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:02:49.665795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:49.667879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:49.669135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.669640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.670245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.688634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:49.694877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:49.695801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:49.696549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:49.699178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 66/128] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:49.705353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:49.768324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:49.812131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f353114-681c-4efe-b22c-1b2fb4cd28df None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:49.866230 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:49.866714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.867000 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.867276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.883714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:49.888996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:49.889915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:49.890766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 63/129] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:02:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:49.897777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:49.903793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b6705f-d39e-457a-a85f-d52ad6021a6a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:49.954570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:49.955215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:49.955504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:49.955789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:49.956491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:49.956801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:49.958255 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:49.973171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 67/130] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:49.979019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:50.031729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f49497-46fb-4fa7-89e0-951a957084eb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:50.035495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:50.079576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:50.093152 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:50.094182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.094660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.095165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.096039 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:50.096533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:50.099488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:50.121667 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 64/131] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:02:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:50.128470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:50.154086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d514bc-0034-4a18-8f15-7d7999307c0e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:50.209839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:50.210566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.210849 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.211120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.213719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:50.215222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:50.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 68/132] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:49 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:50.229956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:50.315610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a03e0d-576e-46a2-9d73-52878c7ee0c8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:50.382996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:50.388708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c0836bd-0c4f-444f-983b-d70a950c8452 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:50.402785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:50.403826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.404373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.404850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.406364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:50.408055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:50.410236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 65/133] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:50 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:50.418649 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:50.458083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:50.458823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.459350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.459635 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] PATH_INFO: `/v3/projects/cb4c65f878074a7f936eabe998169411` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.462157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] RBAC: Authorizing `identity:get_project(project_id=cb4c65f878074a7f936eabe998169411)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:50.464312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:50.470086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 69/134] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:50 2022] GET /identity/v3/projects/cb4c65f878074a7f936eabe998169411 => generated 312 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:50.473076 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:50.534175 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:50.624114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c4f881-33ba-4508-91dc-64ddc85869ff None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:50.654866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b993a3cd-75ca-4348-a090-e38926dd6b2e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:50.691542 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:50.692457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.693561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.693999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.695941 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:50.698015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:50.701418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 66/135] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:50 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:50.707774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97899b36-e3f0-44e2-a960-a01bbf38d95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:50.709041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899b36-e3f0-44e2-a960-a01bbf38d95a None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.709477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899b36-e3f0-44e2-a960-a01bbf38d95a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.709899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97899b36-e3f0-44e2-a960-a01bbf38d95a None admin] PATH_INFO: `/v3/projects/cb4c65f878074a7f936eabe998169411/users/4d5bc0e65035421b90d55b3b2e8b5ce6/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.712132 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97899b36-e3f0-44e2-a960-a01bbf38d95a None admin] RBAC: Authorizing `identity:create_grant(project_id=cb4c65f878074a7f936eabe998169411, user_id=4d5bc0e65035421b90d55b3b2e8b5ce6, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:50.713831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97899b36-e3f0-44e2-a960-a01bbf38d95a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:50.718171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:50.744958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 70/136] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:02:50 2022] PUT /identity/v3/projects/cb4c65f878074a7f936eabe998169411/users/4d5bc0e65035421b90d55b3b2e8b5ce6/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:02:50.838948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dafee91-e8fc-4f48-a817-ce9dd7e5964d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:50.868756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:50.877917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606be1b-22c4-462d-8954-1d5fa38e5995 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.878277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606be1b-22c4-462d-8954-1d5fa38e5995 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.878522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:50.878653 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f606be1b-22c4-462d-8954-1d5fa38e5995 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.879450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.880026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 71/137] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:50.880297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.880718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891/users/4d5bc0e65035421b90d55b3b2e8b5ce6/roles/0167dcf165304e1390fd26c235128524` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.883183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] RBAC: Authorizing `identity:create_grant(project_id=5eed008ec382415094a2620db0a75891, user_id=4d5bc0e65035421b90d55b3b2e8b5ce6, role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:50.885025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252dc4e-7c9b-4c77-b11b-931ea1f6c48c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:50.885307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252dc4e-7c9b-4c77-b11b-931ea1f6c48c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:50.885580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0252dc4e-7c9b-4c77-b11b-931ea1f6c48c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:50.887709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:50.903686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 67/138] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:02:50 2022] PUT /identity/v3/projects/5eed008ec382415094a2620db0a75891/users/4d5bc0e65035421b90d55b3b2e8b5ce6/roles/0167dcf165304e1390fd26c235128524 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:02:50.911620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0252dc4e-7c9b-4c77-b11b-931ea1f6c48c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:50.912778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0252dc4e-7c9b-4c77-b11b-931ea1f6c48c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:50.944032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:51.001084 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 72/139] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:51.024789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:51.149944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cabb860b-81d9-4004-b0e0-5ba2f22182eb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:51.190377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:51.190956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:51.191237 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:51.191511 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:51.207768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:51.213160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:51.214077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:51.214854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 68/140] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:51.220768 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252dc4e-7c9b-4c77-b11b-931ea1f6c48c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:51.337646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0252dc4e-7c9b-4c77-b11b-931ea1f6c48c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:51.377114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:51.377777 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:51.378078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:51.378352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:51.379060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:51.379370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:51.380816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:51.392279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 73/141] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:51.398018 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:51.450402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:51.502378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177010eb-765c-41d6-8b4d-438dda09c8fc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:51.536797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:51.537492 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:51.537784 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:51.538084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:51.539229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:51.540690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:51.542611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 69/142] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:51 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:51.548491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:51.572278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:51.685801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd34a54-353e-479d-afa3-410cf97d4b0d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:51.726962 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:51.727739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:51.727903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:51.728215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:51.805976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:51.807488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:51.827574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:51.919285 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 74/143] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:51.925067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:52.026408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80118d-bc53-4db6-bf7f-e3027815fba7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:52.043334 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:52.061089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c07183-2e67-443d-977d-a8228b14d3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:52.061977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07183-2e67-443d-977d-a8228b14d3ec None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.062459 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07183-2e67-443d-977d-a8228b14d3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.062739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c07183-2e67-443d-977d-a8228b14d3ec None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.063900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07183-2e67-443d-977d-a8228b14d3ec None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:52.066045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c07183-2e67-443d-977d-a8228b14d3ec None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:52.068030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 70/144] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:51 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:52.073914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:52.210955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30d7f8-2d87-4362-ad61-2cf1d52a5a81 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:52.238077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:52.255440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c51406-e377-4015-98b7-ea7392a65c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:52.256365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c51406-e377-4015-98b7-ea7392a65c87 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.256841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c51406-e377-4015-98b7-ea7392a65c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.257326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c51406-e377-4015-98b7-ea7392a65c87 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.258295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c51406-e377-4015-98b7-ea7392a65c87 None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=4d5bc0e65035421b90d55b3b2e8b5ce6) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:52.258800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c51406-e377-4015-98b7-ea7392a65c87 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:52.260464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c51406-e377-4015-98b7-ea7392a65c87 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:52.267020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 75/145] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:52 2022] GET /identity/v3/role_assignments?user.id=4d5bc0e65035421b90d55b3b2e8b5ce6&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:52.357012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c488eb-4872-4c53-a94c-cc2d6bcbfea0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.357528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c488eb-4872-4c53-a94c-cc2d6bcbfea0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.357528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c488eb-4872-4c53-a94c-cc2d6bcbfea0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.358976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 71/146] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:52.364852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f260-d8fe-4a8f-8101-8518e8e72a4f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.365265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f260-d8fe-4a8f-8101-8518e8e72a4f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.365636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067f260-d8fe-4a8f-8101-8518e8e72a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.385083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f067f260-d8fe-4a8f-8101-8518e8e72a4f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:52.386477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f067f260-d8fe-4a8f-8101-8518e8e72a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:52.445566 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48e58-931b-4a58-bd64-e0711f0eefc5 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.446273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48e58-931b-4a58-bd64-e0711f0eefc5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.446768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e48e58-931b-4a58-bd64-e0711f0eefc5 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.449377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 72/147] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:52.455953 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5332f29-631d-4ab3-840d-9dd29c78cf6c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.456513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5332f29-631d-4ab3-840d-9dd29c78cf6c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.457002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5332f29-631d-4ab3-840d-9dd29c78cf6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.486440 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f5332f29-631d-4ab3-840d-9dd29c78cf6c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:52.487634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f5332f29-631d-4ab3-840d-9dd29c78cf6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:52.506850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 76/148] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:52.582339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f260-d8fe-4a8f-8101-8518e8e72a4f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:52.597676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 73/149] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:52.687279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5332f29-631d-4ab3-840d-9dd29c78cf6c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:52.712978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067f260-d8fe-4a8f-8101-8518e8e72a4f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:52.746497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:52.752777 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:52.753619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.754090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.754599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.766251 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:52.771291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:52.772144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:02:52.772908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:52.775565 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 77/150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:02:52.782010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:52.896209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5332f29-631d-4ab3-840d-9dd29c78cf6c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:52.912306 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024bde10-b340-43cd-9b31-4bbcf38e9d1b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:52.919078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:52.955049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:52.955958 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:52.956788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.957602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:52.958070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.958533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:52.958969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.959425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:52.960271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:52.961267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:52.962044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:52.963979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:52.965305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:52.968708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 74/151] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:52.974431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:52.980391 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 78/152] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:52.987591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:53.070455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:53.157293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39bfd45-99c7-4eb2-8f73-6551ff919b9b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:53.166181 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11335d6e-6979-4c69-ab06-f5c710dc7565 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:53.195428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb4f908-19e8-49da-851f-6a1dc0f161c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:53.196044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f908-19e8-49da-851f-6a1dc0f161c3 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.196318 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f908-19e8-49da-851f-6a1dc0f161c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.196587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb4f908-19e8-49da-851f-6a1dc0f161c3 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.197332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4f908-19e8-49da-851f-6a1dc0f161c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:53.198899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb4f908-19e8-49da-851f-6a1dc0f161c3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:53.203109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654f417-efb8-4296-837e-ce7e584dee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:53.204018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f417-efb8-4296-837e-ce7e584dee9f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.204471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f417-efb8-4296-837e-ce7e584dee9f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.204910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654f417-efb8-4296-837e-ce7e584dee9f None admin] PATH_INFO: `/v3/users/dd7a2bc3b75245ea9cc7cf09107cd208` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.206312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654f417-efb8-4296-837e-ce7e584dee9f None admin] RBAC: Authorizing `identity:get_user(user_id=dd7a2bc3b75245ea9cc7cf09107cd208)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:53.207966 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654f417-efb8-4296-837e-ce7e584dee9f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:53.210068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 79/153] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:52 2022] GET /identity/v3/users/dd7a2bc3b75245ea9cc7cf09107cd208 => generated 289 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:53.211405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccade1c-91b6-4cac-92dd-b47c477683ca None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.211690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccade1c-91b6-4cac-92dd-b47c477683ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.211958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccade1c-91b6-4cac-92dd-b47c477683ca None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.213277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 80/154] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:53.215329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccade1c-91b6-4cac-92dd-b47c477683ca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:53.236543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 75/155] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:02:52 2022] POST /identity/v3/users => generated 283 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:02:53.237985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9e31-a614-48ec-bcce-7279a3c671e7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.238380 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9e31-a614-48ec-bcce-7279a3c671e7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.238655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fb9e31-a614-48ec-bcce-7279a3c671e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.259003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b2fb9e31-a614-48ec-bcce-7279a3c671e7 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:53.260329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b2fb9e31-a614-48ec-bcce-7279a3c671e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:53.303050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:53.379136 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 76/156] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:53.402935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccade1c-91b6-4cac-92dd-b47c477683ca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:53.404515 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9e31-a614-48ec-bcce-7279a3c671e7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:53.406395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:53.474998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:53.475985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.476457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.476940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.478320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:53.480068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:53.481925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 81/157] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:53 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:53.488073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:53.531628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fb9e31-a614-48ec-bcce-7279a3c671e7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:53.576546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:53.577839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.578487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.579028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.593371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:53.599040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:53.599978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:53.600768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:53.603467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 77/158] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:02:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:53.605583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d35dd2c-f051-4f66-bfb9-be376fee5589 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:53.613744 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:53.652752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:53.652959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d883c7-3481-44c0-a93e-595d71696e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:53.653571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d883c7-3481-44c0-a93e-595d71696e53 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.654360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d883c7-3481-44c0-a93e-595d71696e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.654464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d883c7-3481-44c0-a93e-595d71696e53 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891/users/dd7a2bc3b75245ea9cc7cf09107cd208/roles/109c3809326c4439ae93c5f162b01640` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.656859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d883c7-3481-44c0-a93e-595d71696e53 None admin] RBAC: Authorizing `identity:create_grant(project_id=5eed008ec382415094a2620db0a75891, user_id=dd7a2bc3b75245ea9cc7cf09107cd208, role_id=109c3809326c4439ae93c5f162b01640)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:53.658822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d883c7-3481-44c0-a93e-595d71696e53 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:53.680035 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 82/159] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:02:53 2022] PUT /identity/v3/projects/5eed008ec382415094a2620db0a75891/users/dd7a2bc3b75245ea9cc7cf09107cd208/roles/109c3809326c4439ae93c5f162b01640 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:02:53.738492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23833e-6229-4404-84ca-581eda50695a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.738791 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23833e-6229-4404-84ca-581eda50695a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.738954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b23833e-6229-4404-84ca-581eda50695a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.740454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 83/160] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:53.747180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1654-ba5d-4f4a-a375-6d09188531f4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.747790 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1654-ba5d-4f4a-a375-6d09188531f4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.747790 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3f1654-ba5d-4f4a-a375-6d09188531f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.754646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c36c37c-8eba-40af-ba56-774b12bc8ce7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:53.775057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ad3f1654-ba5d-4f4a-a375-6d09188531f4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:53.776294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ad3f1654-ba5d-4f4a-a375-6d09188531f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:53.800361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:53.801108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.801393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.801667 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.802419 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:53.802908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:53.804687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:53.813358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:53.816963 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 78/161] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:53.826394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:53.880058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 84/162] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:53.881543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c6384-0470-495a-927e-c8f89e1b294e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.881832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c6384-0470-495a-927e-c8f89e1b294e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.884012 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131c6384-0470-495a-927e-c8f89e1b294e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.885452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 85/163] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:53.891504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b33ae-7827-40da-93ac-9d98306faef9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:53.891797 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b33ae-7827-40da-93ac-9d98306faef9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:53.892048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540b33ae-7827-40da-93ac-9d98306faef9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:53.913885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-540b33ae-7827-40da-93ac-9d98306faef9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:53.915117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-540b33ae-7827-40da-93ac-9d98306faef9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:53.961516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:53.972912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac200cc-decd-4446-9d63-de345bd31bb1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:53.996481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 86/164] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:53.997274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b33ae-7827-40da-93ac-9d98306faef9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.027948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.028862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.029153 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.029521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] PATH_INFO: `/v3/users/cee3be3b33524c19a70d02b4d0135141` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.034839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] RBAC: Authorizing `identity:get_user(user_id=cee3be3b33524c19a70d02b4d0135141)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:54.036314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:54.038317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 79/165] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:53 2022] GET /identity/v3/users/cee3be3b33524c19a70d02b4d0135141 => generated 247 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:54.039857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.113876 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:54.130243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540b33ae-7827-40da-93ac-9d98306faef9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:54.171029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd08ccc-6650-4309-af41-c3c4b4296275 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:54.173721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.174887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.175073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.175329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.189009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:54.194385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:54.195261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:54.196057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 87/166] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:54.196951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.219168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.220224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.220747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.221232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.233493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:54.239664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:54.240557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:54.241356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:54.244065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 80/167] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:02:54.245091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:54.327919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48381f7d-6d28-449e-a9d2-4376aea704ea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:54.368822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e535b-78c4-43f7-8125-8553c48c56e2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:54.373520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.373520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.374005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.374404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.400511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:54.410222 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.410877 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.411109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.411378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.412043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:54.412340 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:54.413882 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:54.423663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 81/168] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:54.427072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.500256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:54.501735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:54.575395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:54.609453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a5891-8f61-4a19-8512-1e87bc461d4b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:54.671899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.672515 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.672787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.673055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.673725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:54.674022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:54.675411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:54.680291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 88/169] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:54.681265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.697293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 82/170] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:54.703021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.778778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:54.867627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd77926f-9897-40e0-ad02-4bfb52e6571a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:54.879620 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d556ff69-2b58-40df-a142-95f05722065c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:54.929962 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.930616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.930889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.931155 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.933094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:54.935187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:54.938005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 89/171] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:54.942161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:54.942863 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:54.943137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:54.943411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:54.944649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.945620 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:54.947193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:54.951457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 83/172] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:54.952286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:54.974414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:55.066694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6d83fe-003a-4574-a482-ef98d98deebe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:55.085134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:55.103912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:55.104935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:55.105455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:55.105923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] PATH_INFO: `/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:55.112748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] RBAC: Authorizing `identity:get_user(user_id=4d5bc0e65035421b90d55b3b2e8b5ce6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:55.114540 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:55.115341 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d594b-75b1-489e-92d2-d07815a84d26 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:55.121657 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 90/173] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/users/4d5bc0e65035421b90d55b3b2e8b5ce6 => generated 275 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:55.122787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:55.191537 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:55.192184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:55.192468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:55.192742 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:55.233462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343209f1-34e6-4770-99d9-f5cc9ec937d8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:55.270684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:55.271700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:55.272247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:55.272729 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:55.273658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=cee3be3b33524c19a70d02b4d0135141) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:55.274183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:55.275983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:55.282675 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 91/174] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:55 2022] GET /identity/v3/role_assignments?user.id=cee3be3b33524c19a70d02b4d0135141&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:55.283799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:55.339468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:55.388523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:55.389777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:55.394765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa791b-ffaa-4856-b835-c0022c9fdf61 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:55.416622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:55.430975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:55.432928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:55.433411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:55.435381 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:55.590610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 84/175] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 639 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:55.597368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:55.611254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:55.612790 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:55.726320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ee2f0-1dad-4472-a5fa-6ebf43689d84 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:55.736691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:55.745944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:55.798103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 92/176] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:55.805226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:55.817751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:55.818832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:55.819306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:55.819791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] PATH_INFO: `/v3/projects/cb4c65f878074a7f936eabe998169411` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:55.822952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] RBAC: Authorizing `identity:get_project(project_id=cb4c65f878074a7f936eabe998169411)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:55.825377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:55.830468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 85/177] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:55 2022] GET /identity/v3/projects/cb4c65f878074a7f936eabe998169411 => generated 312 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:55.856535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:56.014381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098405d8-b85f-4ec0-adac-3bbe6caf56d4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:56.016884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d509a1-287f-4a4a-a6f9-49737094b866 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:56.060665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:56.061696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:56.062255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:56.062751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:56.064119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=cb4c65f878074a7f936eabe998169411, user.id=4d5bc0e65035421b90d55b3b2e8b5ce6) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:56.064972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:56.066677 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:56.073553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 86/178] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:55 2022] GET /identity/v3/role_assignments?user.id=4d5bc0e65035421b90d55b3b2e8b5ce6&scope.project.id=cb4c65f878074a7f936eabe998169411&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:56.110970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9f16dc-3bd5-422c-9fd6-1d46305c6225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:56.111648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f16dc-3bd5-422c-9fd6-1d46305c6225 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:56.111927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f16dc-3bd5-422c-9fd6-1d46305c6225 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:56.114985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9f16dc-3bd5-422c-9fd6-1d46305c6225 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:56.114985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f16dc-3bd5-422c-9fd6-1d46305c6225 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:56.115213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9f16dc-3bd5-422c-9fd6-1d46305c6225 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:56.118507 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 93/179] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:55 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:56.123539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:56.202328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:56.303956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a181a063-0e33-4c55-a414-f57f236b17e4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:56.348000 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f6598-c693-4798-a5c0-d6098a56c3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:56.348664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6598-c693-4798-a5c0-d6098a56c3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:56.348945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6598-c693-4798-a5c0-d6098a56c3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:56.349217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f6598-c693-4798-a5c0-d6098a56c3e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:56.349950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f6598-c693-4798-a5c0-d6098a56c3e1 None admin] RBAC: Adding query filter params (role.id=0167dcf165304e1390fd26c235128524, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=4d5bc0e65035421b90d55b3b2e8b5ce6) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:56.350286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f6598-c693-4798-a5c0-d6098a56c3e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:56.351822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f6598-c693-4798-a5c0-d6098a56c3e1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:56.363138 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 87/180] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:56 2022] GET /identity/v3/role_assignments?user.id=4d5bc0e65035421b90d55b3b2e8b5ce6&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=0167dcf165304e1390fd26c235128524 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:56.792798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b9b4-7821-45ad-b99a-271bc75d510d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:56.793193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b9b4-7821-45ad-b99a-271bc75d510d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:56.793369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7672b9b4-7821-45ad-b99a-271bc75d510d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:56.795032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 94/181] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:56.800725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5a4e-790a-4ee2-b211-1949392b6402 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:56.801190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5a4e-790a-4ee2-b211-1949392b6402 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:56.802554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc5a4e-790a-4ee2-b211-1949392b6402 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:56.816405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6748b55-510e-4378-a00a-20d34784b696 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:56.816928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6748b55-510e-4378-a00a-20d34784b696 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:56.816928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6748b55-510e-4378-a00a-20d34784b696 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:56.818303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 95/182] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:56.824865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ff71-a5c2-4888-81e2-9107387a7a09 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:56.825198 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ff71-a5c2-4888-81e2-9107387a7a09 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:56.825412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7661ff71-a5c2-4888-81e2-9107387a7a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:56.826106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6adc5a4e-790a-4ee2-b211-1949392b6402 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:56.827486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6adc5a4e-790a-4ee2-b211-1949392b6402 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:56.844062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7661ff71-a5c2-4888-81e2-9107387a7a09 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:56.845282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7661ff71-a5c2-4888-81e2-9107387a7a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:56.861387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:56.901163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 88/183] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:56.930535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5a4e-790a-4ee2-b211-1949392b6402 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:56.936073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 96/184] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:56.965059 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ff71-a5c2-4888-81e2-9107387a7a09 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:56.977272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.041579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc5a4e-790a-4ee2-b211-1949392b6402 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.075480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7661ff71-a5c2-4888-81e2-9107387a7a09 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.084688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387e6244-e2ca-4980-b027-a525058be3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.085322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6244-e2ca-4980-b027-a525058be3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.085597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6244-e2ca-4980-b027-a525058be3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.085852 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387e6244-e2ca-4980-b027-a525058be3e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.087012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e6244-e2ca-4980-b027-a525058be3e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:57.088452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387e6244-e2ca-4980-b027-a525058be3e5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:57.090474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 89/185] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:57.091593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598a61-d342-4501-a1fc-31e81f734b78 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.091871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598a61-d342-4501-a1fc-31e81f734b78 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.092151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15598a61-d342-4501-a1fc-31e81f734b78 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.094976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 90/186] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:57.094976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d95d-58e7-4fc5-b6de-bd085c34d508 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.095206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d95d-58e7-4fc5-b6de-bd085c34d508 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.095280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b50d95d-58e7-4fc5-b6de-bd085c34d508 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.096695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 91/187] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:57 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:57.097462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d95d-58e7-4fc5-b6de-bd085c34d508 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.113719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0821212-dc93-4b5b-9f60-5692d1068237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.114405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821212-dc93-4b5b-9f60-5692d1068237 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.114661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821212-dc93-4b5b-9f60-5692d1068237 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.114927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0821212-dc93-4b5b-9f60-5692d1068237 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.129594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0821212-dc93-4b5b-9f60-5692d1068237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c0821212-dc93-4b5b-9f60-5692d1068237 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:57.134303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:57.135175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:57.135961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 97/188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:02:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:57.136598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3bd0-a077-42d9-8ff0-361dde8a6135 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.136781 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3bd0-a077-42d9-8ff0-361dde8a6135 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.137027 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c3bd0-a077-42d9-8ff0-361dde8a6135 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.154012 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2a5c3bd0-a077-42d9-8ff0-361dde8a6135 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:57.155407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2a5c3bd0-a077-42d9-8ff0-361dde8a6135 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:57.157444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.205808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b50d95d-58e7-4fc5-b6de-bd085c34d508 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.208525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.221525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 98/189] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:57.222780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154f382-53ff-4be7-b0fe-1fe038282d8a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.223061 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154f382-53ff-4be7-b0fe-1fe038282d8a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.223332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7154f382-53ff-4be7-b0fe-1fe038282d8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.240356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7154f382-53ff-4be7-b0fe-1fe038282d8a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:57.241530 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7154f382-53ff-4be7-b0fe-1fe038282d8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:57.253608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.254257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.254519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.254790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.255418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:57.256840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:57.278750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 92/190] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:02:57 2022] POST /identity/v3/users => generated 297 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:02:57.279554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.313192 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 99/191] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:57.314190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154f382-53ff-4be7-b0fe-1fe038282d8a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.389247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.428684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7154f382-53ff-4be7-b0fe-1fe038282d8a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.430622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9918f9-1664-4a36-9adb-275a9077d63c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.467762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.468199 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.468476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.468755 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.475259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.475929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.476301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.476580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.477445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:57.477737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:57.479591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:57.479723 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:57.485202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:57.486193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:57.486985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 100/192] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:57.487621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.492032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 93/193] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:57.495048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.524724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.602984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1333885-4eec-42bf-99b3-f9ee51d69ab0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.627190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6a3733-3cd5-4582-9ecd-9eeed37f70e8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.635640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.642787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.643754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.644180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.644576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.659292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:57.663663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.664284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.664561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:57.664676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:57.665504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:02:57.666304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:02:57.666914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.666914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:57.667041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 101/194] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:57.667107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:57.667171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.667233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:57.685348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 94/195] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:57.686502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.783462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.792315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7646374-59a4-4389-ba85-0858c72ceb24 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.800973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ccdbc6-1b2f-45b0-a140-5b8ca5b21676 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:57.839543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.839780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:57.840201 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.840445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:57.840558 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.840629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:57.840694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.840852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] PATH_INFO: `/v3/users/6483a7ef05094147acc92428a5de641f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:57.841407 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:57.841648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:57.843707 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:57.857471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] RBAC: Authorizing `identity:get_user(user_id=6483a7ef05094147acc92428a5de641f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:57.859044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:57.860520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 95/196] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:57.861394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 102/197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/users/6483a7ef05094147acc92428a5de641f => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:57.861500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.866241 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:57.936735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:57.984124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea61223-04e3-47b1-b639-8e497be68d9e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.012398 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe80bcc-bb94-4202-9b5b-9718e5a7a8e8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.019395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.020037 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.020317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.020589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] PATH_INFO: `/v3/users/dd7a2bc3b75245ea9cc7cf09107cd208` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.022146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] RBAC: Authorizing `identity:get_user(user_id=dd7a2bc3b75245ea9cc7cf09107cd208)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.023975 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.026573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 96/198] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/users/dd7a2bc3b75245ea9cc7cf09107cd208 => generated 289 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:58.027585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.048375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:58.054974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.055633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.056416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.056840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] PATH_INFO: `/v3/users/6483a7ef05094147acc92428a5de641f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.058322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] RBAC: Authorizing `identity:get_user(user_id=6483a7ef05094147acc92428a5de641f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.060800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.063495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 103/199] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:02:57 2022] GET /identity/v3/users/6483a7ef05094147acc92428a5de641f => generated 283 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:58.064408 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.176901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c81693e-d189-47f1-9151-820de59ee661 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.185711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3279bc-04ee-4a9a-96c6-dbdc0d17858c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.202650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:58.219428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.220403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.220916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.221475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.228043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.228658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.228936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.229209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.296530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.298569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.315204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:58.315654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.318236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.416699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 97/200] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:58.416699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.436976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 104/201] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:58.438288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.453913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:58.538179 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f27ab0-d224-4eff-ac11-a581997dac5f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.543194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e1f494-df93-48c7-a6fc-cb3cf044071c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.559922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:58.588038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.588683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.588964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.589240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.590358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.590973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.591075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.591244 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.591513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.593386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.597102 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 105/202] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:58.598246 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.665748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.667259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.710999 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:58.730491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e36010-dc85-472b-b265-0fec842bc44f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.767890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.768930 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.769472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.769930 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.771343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.773104 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.775006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 106/203] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:58.780490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 98/204] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:02:58.780490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.782461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.791583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:58.881616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2df9506-0321-48df-b589-9b5802ae7358 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.890723 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c473ed9-44e4-40c6-a51e-994732b53256 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:58.918277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.918895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.919177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.919452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.920289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=6483a7ef05094147acc92428a5de641f) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:58.920633 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.922305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.928331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 99/205] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/role_assignments?user.id=6483a7ef05094147acc92428a5de641f&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:58.929146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.929752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:58.930644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:58.931138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:58.931688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:58.933159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:58.934970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:58.937183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 107/206] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:58.947240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:58.990537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:59.028019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:59.049289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5de416b-5ed5-49cf-834c-f0bd3f5ed13f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:59.086907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425312be-14ef-4634-90a6-026ca555a1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:59.087666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425312be-14ef-4634-90a6-026ca555a1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.087948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425312be-14ef-4634-90a6-026ca555a1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.088224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425312be-14ef-4634-90a6-026ca555a1c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.088972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425312be-14ef-4634-90a6-026ca555a1c5 None admin] RBAC: Adding query filter params (role.id=109c3809326c4439ae93c5f162b01640, scope.project.id=5eed008ec382415094a2620db0a75891, user.id=dd7a2bc3b75245ea9cc7cf09107cd208) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:59.089280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425312be-14ef-4634-90a6-026ca555a1c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:59.090791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425312be-14ef-4634-90a6-026ca555a1c5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:59.097702 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 100/207] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/role_assignments?user.id=dd7a2bc3b75245ea9cc7cf09107cd208&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=109c3809326c4439ae93c5f162b01640 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:59.182811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f43799-d042-49fa-8be3-d02e07cece79 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:59.220400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15271ac-df68-4314-81bd-7a02f4d48248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:59.221023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15271ac-df68-4314-81bd-7a02f4d48248 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.221304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15271ac-df68-4314-81bd-7a02f4d48248 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.221574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15271ac-df68-4314-81bd-7a02f4d48248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.222350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15271ac-df68-4314-81bd-7a02f4d48248 None admin] RBAC: Adding query filter params (role.id=0167dcf165304e1390fd26c235128524, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=6483a7ef05094147acc92428a5de641f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:02:59.222654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15271ac-df68-4314-81bd-7a02f4d48248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:59.224135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15271ac-df68-4314-81bd-7a02f4d48248 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:59.230541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 108/208] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:02:58 2022] GET /identity/v3/role_assignments?user.id=6483a7ef05094147acc92428a5de641f&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=0167dcf165304e1390fd26c235128524 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:02:59.572854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62cee-9382-4f2c-998f-a0688b9301c6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.573231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62cee-9382-4f2c-998f-a0688b9301c6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.573400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb62cee-9382-4f2c-998f-a0688b9301c6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.574789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 101/209] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:02:59.580537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682907a0-9a80-48d4-afec-8879bb786654 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.580816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682907a0-9a80-48d4-afec-8879bb786654 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.581152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682907a0-9a80-48d4-afec-8879bb786654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.583466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4496a7-d2d5-4e56-80f2-b8d1dcb1032c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.583757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4496a7-d2d5-4e56-80f2-b8d1dcb1032c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.584038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4496a7-d2d5-4e56-80f2-b8d1dcb1032c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.585342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 102/210] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:02:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:02:59.590307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87e3f7-2c98-4bc6-ace6-c8cf28e0b8eb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.590600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87e3f7-2c98-4bc6-ace6-c8cf28e0b8eb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.591246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87e3f7-2c98-4bc6-ace6-c8cf28e0b8eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.607469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-682907a0-9a80-48d4-afec-8879bb786654 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:59.608715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-682907a0-9a80-48d4-afec-8879bb786654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:59.612423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-da87e3f7-2c98-4bc6-ace6-c8cf28e0b8eb None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:02:59.614578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-da87e3f7-2c98-4bc6-ace6-c8cf28e0b8eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:02:59.685509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 103/211] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:02:59.687919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 109/212] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:02:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:02:59.708798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87e3f7-2c98-4bc6-ace6-c8cf28e0b8eb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:59.711663 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682907a0-9a80-48d4-afec-8879bb786654 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:59.730458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:59.792191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:02:59.825182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682907a0-9a80-48d4-afec-8879bb786654 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:59.832314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87e3f7-2c98-4bc6-ace6-c8cf28e0b8eb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:02:59.862932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:59.864142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.864564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.864841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.866644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:02:59.868614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:02:59.870784 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 110/213] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:02:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:02:59.876479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:59.878125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:02:59.878782 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:02:59.879354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:02:59.879633 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:02:59.894218 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:02:59.900231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:02:59.901328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:02:59.902357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:02:59.910248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 104/214] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:02:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:02:59.910809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:02:59.984253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:00.014212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50be77-2d3a-4ce0-a6c5-fd35f05a4132 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:00.029799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf2a034-1687-4195-9f26-b285cd701072 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:00.060545 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:00.061612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:00.062936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:00.063397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:00.063870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:00.065115 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:00.067065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:00.067757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:00.068443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:00.068803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:00.069143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:00.069934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:00.070326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:00.071890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:00.086263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 105/215] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:02:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:00.087151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:00.101903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 111/216] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:02:59 2022] POST /identity/v3/users => generated 297 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:03:00.209642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b8888-5677-4a9a-82aa-f23884edc289 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:00.250081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:00.250800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:00.251080 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:00.251353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] PATH_INFO: `/v3/users/c09b7b0bd2944f34bbd684760e913ede` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:00.269362 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] RBAC: Authorizing `identity:get_user(user_id=c09b7b0bd2944f34bbd684760e913ede)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:00.271821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:00.273687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 106/217] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:00 2022] GET /identity/v3/users/c09b7b0bd2944f34bbd684760e913ede => generated 297 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:00.279583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:00.383936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5eaef3f-7476-412f-b6f3-8b1966caa636 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:00.425190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:00.426360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:00.426360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:00.426545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:00.431150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:00.510158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:00.511649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:00.618160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 112/218] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 01:03:00.623463 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:00.685654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:00.746275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc7d22-afb7-4d27-a5df-0a23dc31d1a9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:00.795960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656051db-ba4c-4438-ad66-781f895f855f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:00.796951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656051db-ba4c-4438-ad66-781f895f855f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:00.797459 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656051db-ba4c-4438-ad66-781f895f855f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:00.797901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656051db-ba4c-4438-ad66-781f895f855f None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:00.799727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656051db-ba4c-4438-ad66-781f895f855f None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:00.801406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656051db-ba4c-4438-ad66-781f895f855f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:00.803615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 107/219] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:00 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:00.809388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:00.857489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:00.933827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba19db86-f53d-4406-9312-903f99bdb54d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:00.980204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92dc6d4-4587-4be9-85e6-d6adfc8953db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:00.981126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dc6d4-4587-4be9-85e6-d6adfc8953db None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:00.981600 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dc6d4-4587-4be9-85e6-d6adfc8953db None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:00.982038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92dc6d4-4587-4be9-85e6-d6adfc8953db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:00.982965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dc6d4-4587-4be9-85e6-d6adfc8953db None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=c09b7b0bd2944f34bbd684760e913ede) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:00.983494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dc6d4-4587-4be9-85e6-d6adfc8953db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:00.985159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92dc6d4-4587-4be9-85e6-d6adfc8953db None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:00.993171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 113/220] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:00 2022] GET /identity/v3/role_assignments?user.id=c09b7b0bd2944f34bbd684760e913ede&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:01.207710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360c7c-79ae-436a-82dc-df67090d8965 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.208630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360c7c-79ae-436a-82dc-df67090d8965 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.209084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5360c7c-79ae-436a-82dc-df67090d8965 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.210739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 108/221] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:01.216577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad32052-e8fa-4594-8fbd-eba392fd7a98 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.217156 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad32052-e8fa-4594-8fbd-eba392fd7a98 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.217687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad32052-e8fa-4594-8fbd-eba392fd7a98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.247320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4ad32052-e8fa-4594-8fbd-eba392fd7a98 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:01.248986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4ad32052-e8fa-4594-8fbd-eba392fd7a98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:01.340677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 114/222] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:01.378602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360c7c-79ae-436a-82dc-df67090d8965 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:01.407567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951bdd-4e8b-45b4-a98b-69fa3847b699 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.407845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951bdd-4e8b-45b4-a98b-69fa3847b699 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.408319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5951bdd-4e8b-45b4-a98b-69fa3847b699 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.409813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 115/223] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:01.418012 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391356-a8cc-4f21-b348-cb92881e8ada None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.418592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391356-a8cc-4f21-b348-cb92881e8ada None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.419083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6391356-a8cc-4f21-b348-cb92881e8ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.447368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b6391356-a8cc-4f21-b348-cb92881e8ada None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:01.448562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b6391356-a8cc-4f21-b348-cb92881e8ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:01.495740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:01.526722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5360c7c-79ae-436a-82dc-df67090d8965 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:01.561551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:01.565399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 116/224] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:01.598817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:01.599474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.599755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.600027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.609477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6391356-a8cc-4f21-b348-cb92881e8ada None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:01.613626 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:01.618446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:01.619534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:01.620522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:01.622575 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 109/225] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:01.630499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:01.744650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6391356-a8cc-4f21-b348-cb92881e8ada None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:01.780645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:01.781197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.781534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.781870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.792618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:01.797968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:01.798911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:01.799732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 117/226] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:01.805395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:01.829923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dc36c-1814-4400-94cf-0718b7382701 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:01.830724 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:01.920425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b64900-870d-4699-b2d6-0f72ea414968 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:01.923826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:01.923970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.924205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.924479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.925177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:01.925468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:01.926902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:01.956983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 110/227] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:01.962504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:01.964398 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:01.965226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:01.965639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:01.966175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:01.966986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:01.967499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:01.969065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:01.982881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 118/228] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:01.984744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:02.069832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:02.090410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f304b63f-f1a1-494e-8582-7c4223d3e3f4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:02.095579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:02.127694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:02.128512 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.128965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.129369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] PATH_INFO: `/v3/users/6483a7ef05094147acc92428a5de641f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.130756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] RBAC: Authorizing `identity:get_user(user_id=6483a7ef05094147acc92428a5de641f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:02.133276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:02.140068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 119/229] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:01 2022] GET /identity/v3/users/6483a7ef05094147acc92428a5de641f => generated 283 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:02.141442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:02.245235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5db1f11-e939-460c-80e0-df67f1b9c3ce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:02.280163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:02.280825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.281100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.281367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.282522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:02.284066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:02.285908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 120/230] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:02 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:02.291611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:02.308022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca19454-0a8e-43de-a2ab-d0fc2b3ef85e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:02.319080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:02.398257 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59c9c75-7879-4085-b067-8ea60bb65bd5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:02.433959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b48e6e-71f8-4b54-91ec-c9678c78caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:02.434665 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48e6e-71f8-4b54-91ec-c9678c78caa5 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.434937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48e6e-71f8-4b54-91ec-c9678c78caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.435207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b48e6e-71f8-4b54-91ec-c9678c78caa5 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/6483a7ef05094147acc92428a5de641f/roles/0167dcf165304e1390fd26c235128524` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.437984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48e6e-71f8-4b54-91ec-c9678c78caa5 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6225f957df243e4ac6c2de5b98355ff, user_id=6483a7ef05094147acc92428a5de641f, role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:02.439488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b48e6e-71f8-4b54-91ec-c9678c78caa5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:02.449812 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:02.450510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.450788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.451058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] PATH_INFO: `/v3/users/6483a7ef05094147acc92428a5de641f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.452374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] RBAC: Authorizing `identity:get_user(user_id=6483a7ef05094147acc92428a5de641f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:02.453853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:02.455756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 111/232] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:01 2022] GET /identity/v3/users/6483a7ef05094147acc92428a5de641f => generated 283 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:02.459846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 121/232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:02 2022] PUT /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/6483a7ef05094147acc92428a5de641f/roles/0167dcf165304e1390fd26c235128524 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:02.461043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:02.632274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a5c23-f988-419d-a1f6-7e17c295ba0c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:02.663834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466520-521f-4c98-9f91-03f20d418e5e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.664016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466520-521f-4c98-9f91-03f20d418e5e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.664291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6466520-521f-4c98-9f91-03f20d418e5e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.665693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 122/233] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:02.671382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969d265-965c-455b-b10a-e937176f6aa5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.671667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969d265-965c-455b-b10a-e937176f6aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.671940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7969d265-965c-455b-b10a-e937176f6aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.672480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:02.683324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:02.684008 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.684332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.684600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.687607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:02.689378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:02.691498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 112/234] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:02 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:02.692522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7969d265-965c-455b-b10a-e937176f6aa5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:02.693717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7969d265-965c-455b-b10a-e937176f6aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:02.698334 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:02.806599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 123/235] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:02.834003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969d265-965c-455b-b10a-e937176f6aa5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:02.846032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:02.854414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aada37-d8b0-4ac3-b410-0c606f2f48f6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:02.895139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb422dfe-6d3b-40ca-97cb-7a144e1939f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:02.895814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb422dfe-6d3b-40ca-97cb-7a144e1939f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.896159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb422dfe-6d3b-40ca-97cb-7a144e1939f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.896497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb422dfe-6d3b-40ca-97cb-7a144e1939f8 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/6483a7ef05094147acc92428a5de641f/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.898524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb422dfe-6d3b-40ca-97cb-7a144e1939f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6225f957df243e4ac6c2de5b98355ff, user_id=6483a7ef05094147acc92428a5de641f, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:02.900226 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb422dfe-6d3b-40ca-97cb-7a144e1939f8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:02.921345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 113/236] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:02 2022] PUT /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/6483a7ef05094147acc92428a5de641f/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:02.940554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e613e2-8b02-46a8-b137-cb3ba55db2c9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.941205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e613e2-8b02-46a8-b137-cb3ba55db2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.941690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e613e2-8b02-46a8-b137-cb3ba55db2c9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.943666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 114/237] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:02.949564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f71e23-3245-4e3f-8de4-3576cb3b7847 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:02.950214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f71e23-3245-4e3f-8de4-3576cb3b7847 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:02.950684 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f71e23-3245-4e3f-8de4-3576cb3b7847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:02.961457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7969d265-965c-455b-b10a-e937176f6aa5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:02.970865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-44f71e23-3245-4e3f-8de4-3576cb3b7847 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:02.972449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-44f71e23-3245-4e3f-8de4-3576cb3b7847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:03.020429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:03.069670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:03.070258 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 115/238] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:03.070672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.071130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.071202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.085388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:03.090693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:03.091650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:03.093468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:03.096701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 124/239] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:03.105635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f71e23-3245-4e3f-8de4-3576cb3b7847 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:03.117054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:03.209127 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:03.229234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f71e23-3245-4e3f-8de4-3576cb3b7847 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:03.254009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121ff33c-6cdc-49e4-a1f8-129f00f58690 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:03.280851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:03.281495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.281767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.282033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.282735 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:03.283029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:03.284570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:03.302995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 116/240] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:03.310068 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:03.354618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:03.355271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.355610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.356002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.360764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:03.365495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:03.367067 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 125/241] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:03.370740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:03.388497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:03.479423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646ccb4c-0c61-436e-ab82-83a1809565b6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:03.524367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:03.525148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.525445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.530912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] PATH_INFO: `/v3/users/d599bc4cd1934c47bcc11f84799138e9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.545867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] RBAC: Authorizing `identity:get_user(user_id=d599bc4cd1934c47bcc11f84799138e9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:03.550074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:03.550074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 117/242] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:03 2022] GET /identity/v3/users/d599bc4cd1934c47bcc11f84799138e9 => generated 297 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:03.554987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:03.610821 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caf6e32-1614-4db2-882c-8d25880e696b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:03.656897 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4507022c-d05f-41d8-8cb4-58c0822604e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:03.657888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507022c-d05f-41d8-8cb4-58c0822604e6 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.658386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507022c-d05f-41d8-8cb4-58c0822604e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.659894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4507022c-d05f-41d8-8cb4-58c0822604e6 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.663690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507022c-d05f-41d8-8cb4-58c0822604e6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:03.665392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4507022c-d05f-41d8-8cb4-58c0822604e6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:03.672571 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:03.678556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:03.680288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84ef897-721f-42f2-861b-2c441349f815 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:03.701948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 126/243] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:03 2022] POST /identity/v3/users => generated 293 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:03.704175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443cc28-e3fb-42e2-b045-551774e03756 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.704783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443cc28-e3fb-42e2-b045-551774e03756 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.705270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7443cc28-e3fb-42e2-b045-551774e03756 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.707226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 127/244] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:03.715200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746bdf-02bf-440a-a333-8b58536c4d81 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.715200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746bdf-02bf-440a-a333-8b58536c4d81 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.715200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01746bdf-02bf-440a-a333-8b58536c4d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.728322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:03.728322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:03.728322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:03.728322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:03.747900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-01746bdf-02bf-440a-a333-8b58536c4d81 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:03.749152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-01746bdf-02bf-440a-a333-8b58536c4d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:03.892563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:03.895216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:03.896075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 128/245] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:03.922525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746bdf-02bf-440a-a333-8b58536c4d81 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:04.012665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:04.029489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 118/246] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 01:03:04.035016 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:04.044904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01746bdf-02bf-440a-a333-8b58536c4d81 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:04.068927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:04.086700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:04.087655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:04.090044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:04.090044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:04.111701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:04.116756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:04.117625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:04.118581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 129/247] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:04.125869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:04.154832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5dc9d0-02bb-4cf7-82b1-8003cbe34e14 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:04.196772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:04.197668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:04.198131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:04.198630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:04.200707 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:04.202498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:04.204632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 119/248] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:04 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:04.211101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:04.272808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f6978-cd19-4689-bfb3-801905e3cac5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:04.290178 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:04.321937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:04.322885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:04.323305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:04.323767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:04.324625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:04.325070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:04.326734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:04.336374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 130/249] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:04.342194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:04.346533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a25ed53-3a18-433c-af19-a880a8f6081c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:04.384979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:04.386498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:04.386498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:04.386498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:04.386896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] RBAC: Adding query filter params (role.id=109c3809326c4439ae93c5f162b01640, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=d599bc4cd1934c47bcc11f84799138e9) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:04.387208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:04.388834 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:04.396041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:04.396960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 120/250] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:04 2022] GET /identity/v3/role_assignments?user.id=d599bc4cd1934c47bcc11f84799138e9&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=109c3809326c4439ae93c5f162b01640 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:04.469273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c38ad7-96e9-44f0-84d4-148d700950da None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:04.505902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:04.506855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:04.507276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:04.507691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] PATH_INFO: `/v3/users/c09b7b0bd2944f34bbd684760e913ede` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:04.509147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] RBAC: Authorizing `identity:get_user(user_id=c09b7b0bd2944f34bbd684760e913ede)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:04.510853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:04.512766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 131/251] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:04 2022] GET /identity/v3/users/c09b7b0bd2944f34bbd684760e913ede => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:04.518498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:04.627726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579ad7de-44ea-4b23-b28c-9eb4cdd10d8f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:04.653769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:04.671504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f5bb0d-74e4-4037-838d-918b55b02c07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:04.672165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5bb0d-74e4-4037-838d-918b55b02c07 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:04.672443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5bb0d-74e4-4037-838d-918b55b02c07 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:04.672715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f5bb0d-74e4-4037-838d-918b55b02c07 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:04.674874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5bb0d-74e4-4037-838d-918b55b02c07 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:04.676361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f5bb0d-74e4-4037-838d-918b55b02c07 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:04.678084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 121/252] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:04 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:04.683989 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:04.788188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039084f2-a7d1-49cf-9033-a376b4d0c8f5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:04.801793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:04.824560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38254c6a-57f5-4179-9fd6-36328a22a29e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:04.825238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254c6a-57f5-4179-9fd6-36328a22a29e None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:04.825586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254c6a-57f5-4179-9fd6-36328a22a29e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:04.825871 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38254c6a-57f5-4179-9fd6-36328a22a29e None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/c09b7b0bd2944f34bbd684760e913ede/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:04.827906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254c6a-57f5-4179-9fd6-36328a22a29e None admin] RBAC: Authorizing `identity:create_grant(project_id=e6225f957df243e4ac6c2de5b98355ff, user_id=c09b7b0bd2944f34bbd684760e913ede, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:04.829377 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38254c6a-57f5-4179-9fd6-36328a22a29e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:04.856263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 132/253] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:04 2022] PUT /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/c09b7b0bd2944f34bbd684760e913ede/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:05.536317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385973db-b3af-48d9-9a2a-6c2b194f85f7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:05.536873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385973db-b3af-48d9-9a2a-6c2b194f85f7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:05.536873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385973db-b3af-48d9-9a2a-6c2b194f85f7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:05.538527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 122/254] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:05.543797 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1920271-fd10-4d6e-897c-f2af3b59756b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:05.544185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1920271-fd10-4d6e-897c-f2af3b59756b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:05.544405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1920271-fd10-4d6e-897c-f2af3b59756b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:05.569813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b1920271-fd10-4d6e-897c-f2af3b59756b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:05.571052 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b1920271-fd10-4d6e-897c-f2af3b59756b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:05.656733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 133/255] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:05.677102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7183-ecad-45f4-9f10-799dc5472227 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:05.677404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7183-ecad-45f4-9f10-799dc5472227 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:05.677654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd7183-ecad-45f4-9f10-799dc5472227 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:05.679053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 123/256] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:05.684385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c798c6-0eda-48b3-b131-a502bfec0ae8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:05.684679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c798c6-0eda-48b3-b131-a502bfec0ae8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:05.684958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c798c6-0eda-48b3-b131-a502bfec0ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:05.694306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7183-ecad-45f4-9f10-799dc5472227 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:05.715065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-44c798c6-0eda-48b3-b131-a502bfec0ae8 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:05.716271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-44c798c6-0eda-48b3-b131-a502bfec0ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:05.829548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 134/257] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:05.878339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c798c6-0eda-48b3-b131-a502bfec0ae8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:05.887758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd7183-ecad-45f4-9f10-799dc5472227 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:05.951980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:05.952752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:05.953042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:05.953308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:05.966413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:05.976450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:05.981965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:05.983137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:05.984274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 124/258] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:05.991921 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:06.093789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:06.174798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120a81a8-94b4-46c0-9990-355832030f7f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:06.175917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c798c6-0eda-48b3-b131-a502bfec0ae8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:06.224737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:06.225368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:06.225650 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:06.225922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:06.226685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:06.226989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:06.228369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:06.237656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 125/259] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:06.243422 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:06.259321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:06.259979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:06.260258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:06.260525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:06.279724 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:06.284683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:06.285561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:06.286550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 135/260] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:06.291799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:06.441186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d706f6ea-047e-481f-be87-d377f5a6f801 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:06.458510 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:06.465101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0226a021-3e41-49dc-b719-4dccba0deb0d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:06.466433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:06.511850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:06.512470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:06.512747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:06.513026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:06.513697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:06.514006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:06.523370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:06.533579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 136/261] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:06.539014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:06.547158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:06.548591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:06.549084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:06.549552 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] PATH_INFO: `/v3/users/6483a7ef05094147acc92428a5de641f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:06.554776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] RBAC: Authorizing `identity:get_user(user_id=6483a7ef05094147acc92428a5de641f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:06.556730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:06.558716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 126/262] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:06 2022] GET /identity/v3/users/6483a7ef05094147acc92428a5de641f => generated 283 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:06.565155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:06.652113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c51a158-daa0-4b94-8a29-9db16150011a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:06.691343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:06.691937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:06.692220 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:06.692492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] PATH_INFO: `/v3/users/6483a7ef05094147acc92428a5de641f` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:06.693677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] RBAC: Authorizing `identity:get_user(user_id=6483a7ef05094147acc92428a5de641f)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:06.695169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:06.697223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 137/263] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:06 2022] GET /identity/v3/users/6483a7ef05094147acc92428a5de641f => generated 283 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:06.702364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:06.754422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:06.824038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c9482d-2ba0-4549-a273-6963e4b947a6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:06.887991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f986a9bf-81f8-47da-9595-698c1cc07524 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:06.910779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d832a951-a532-4418-adc3-950d87397261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:06.911415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a951-a532-4418-adc3-950d87397261 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:06.911700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a951-a532-4418-adc3-950d87397261 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:06.911978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d832a951-a532-4418-adc3-950d87397261 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:06.971086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f6712a-2758-42f5-9ac8-5c39aaec3df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:06.971728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6712a-2758-42f5-9ac8-5c39aaec3df7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:06.972005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6712a-2758-42f5-9ac8-5c39aaec3df7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:06.972273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f6712a-2758-42f5-9ac8-5c39aaec3df7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:06.984174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:07.012983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832a951-a532-4418-adc3-950d87397261 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:07.014574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d832a951-a532-4418-adc3-950d87397261 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:07.146905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6712a-2758-42f5-9ac8-5c39aaec3df7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:07.148407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f6712a-2758-42f5-9ac8-5c39aaec3df7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:07.179583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 127/264] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 01:03:07.180954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a116-a25e-4eb7-84fc-b75dafc533bd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.181240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a116-a25e-4eb7-84fc-b75dafc533bd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.181514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f55a116-a25e-4eb7-84fc-b75dafc533bd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.183203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 128/265] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:07.186187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a116-a25e-4eb7-84fc-b75dafc533bd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:07.198900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:07.292121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 138/266] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 590 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:07.293851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb10547-6cdc-4ec5-a943-856a61254328 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.294393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb10547-6cdc-4ec5-a943-856a61254328 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.294917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb10547-6cdc-4ec5-a943-856a61254328 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.298545 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:07.317359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9bb10547-6cdc-4ec5-a943-856a61254328 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:07.319019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9bb10547-6cdc-4ec5-a943-856a61254328 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:07.325576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f55a116-a25e-4eb7-84fc-b75dafc533bd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:07.376792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7fbe61-af4b-46b3-800a-b1793add8a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:07.377468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fbe61-af4b-46b3-800a-b1793add8a07 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.377746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fbe61-af4b-46b3-800a-b1793add8a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.378017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7fbe61-af4b-46b3-800a-b1793add8a07 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.379426 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fbe61-af4b-46b3-800a-b1793add8a07 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:07.381574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe7fbe61-af4b-46b3-800a-b1793add8a07 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:07.387131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 129/267] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:07 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:07.387131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab2f8-5a65-4292-83a6-c1cb54bfcf49 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.387131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab2f8-5a65-4292-83a6-c1cb54bfcf49 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.387131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ab2f8-5a65-4292-83a6-c1cb54bfcf49 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.387131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 130/268] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:07.387659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab2f8-5a65-4292-83a6-c1cb54bfcf49 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:07.410228 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 139/269] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:07.411552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb10547-6cdc-4ec5-a943-856a61254328 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:07.484651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:07.535108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ab2f8-5a65-4292-83a6-c1cb54bfcf49 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:07.535982 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb10547-6cdc-4ec5-a943-856a61254328 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:07.572907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9c3f47-525d-4287-89b0-33d6ecb198b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:07.578895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3f47-525d-4287-89b0-33d6ecb198b3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.578895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3f47-525d-4287-89b0-33d6ecb198b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.578895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9c3f47-525d-4287-89b0-33d6ecb198b3 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.581805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c3f47-525d-4287-89b0-33d6ecb198b3 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:07.583868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9c3f47-525d-4287-89b0-33d6ecb198b3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:07.584827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:07.585527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 131/270] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:07 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:07.586078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.586618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.586791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3c50-993d-4705-964e-80ef01551dcf None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.587070 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3c50-993d-4705-964e-80ef01551dcf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.587341 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd3c50-993d-4705-964e-80ef01551dcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.587643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.588634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=6483a7ef05094147acc92428a5de641f) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:07.589136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:07.591151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:07.606085 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 140/271] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:07 2022] GET /identity/v3/role_assignments?user.id=6483a7ef05094147acc92428a5de641f&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:07.606085 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:07.618308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-16fd3c50-993d-4705-964e-80ef01551dcf None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:07.619524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-16fd3c50-993d-4705-964e-80ef01551dcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:07.643595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:07.738631 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 132/272] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:07.739317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd3c50-993d-4705-964e-80ef01551dcf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:07.777039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b414d9e3-0919-439f-ba31-a9e8308a32f8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:07.799091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:07.823193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81863ccc-2e8d-47b7-9ed1-0096441ccd7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:07.824180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863ccc-2e8d-47b7-9ed1-0096441ccd7f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.824456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863ccc-2e8d-47b7-9ed1-0096441ccd7f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.824888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81863ccc-2e8d-47b7-9ed1-0096441ccd7f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.838888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81863ccc-2e8d-47b7-9ed1-0096441ccd7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-81863ccc-2e8d-47b7-9ed1-0096441ccd7f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:07.844307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:07.845215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 141/273] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:07.846956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40574ffb-1b74-47ba-adcb-b4e3a345ebcc None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.847671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40574ffb-1b74-47ba-adcb-b4e3a345ebcc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.847671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40574ffb-1b74-47ba-adcb-b4e3a345ebcc None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.849057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 142/274] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:07.849349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40574ffb-1b74-47ba-adcb-b4e3a345ebcc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:07.865865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fd3c50-993d-4705-964e-80ef01551dcf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:07.906656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:07.907267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:07.907546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:07.907812 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:07.908532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] RBAC: Adding query filter params (role.id=0167dcf165304e1390fd26c235128524, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=6483a7ef05094147acc92428a5de641f) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:07.908830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:07.910283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:07.915901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 133/275] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:07 2022] GET /identity/v3/role_assignments?user.id=6483a7ef05094147acc92428a5de641f&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=0167dcf165304e1390fd26c235128524 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:07.916661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:07.927799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:07.975428 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40574ffb-1b74-47ba-adcb-b4e3a345ebcc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.013534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0cef553-941e-4422-abb1-a65c96d2186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.014524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef553-941e-4422-abb1-a65c96d2186d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.014924 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef553-941e-4422-abb1-a65c96d2186d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.015203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0cef553-941e-4422-abb1-a65c96d2186d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.028041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0cef553-941e-4422-abb1-a65c96d2186d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:08.030184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52797a00-d5d3-4071-9bcf-1ec1621ce7dc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e0cef553-941e-4422-abb1-a65c96d2186d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:08.033704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:08.040101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 143/276] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:08.040891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b437e-b98c-4edb-a2b3-664d1d2d3527 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.041621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b437e-b98c-4edb-a2b3-664d1d2d3527 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.041621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b437e-b98c-4edb-a2b3-664d1d2d3527 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.057045 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dc4b437e-b98c-4edb-a2b3-664d1d2d3527 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:08.059470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dc4b437e-b98c-4edb-a2b3-664d1d2d3527 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:08.072108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8062ac-2cb1-4f40-8cf6-27e70ccaa9fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.072725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8062ac-2cb1-4f40-8cf6-27e70ccaa9fb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.073003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8062ac-2cb1-4f40-8cf6-27e70ccaa9fb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.073329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8062ac-2cb1-4f40-8cf6-27e70ccaa9fb None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.073945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8062ac-2cb1-4f40-8cf6-27e70ccaa9fb None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:08.074294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8062ac-2cb1-4f40-8cf6-27e70ccaa9fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.075666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8062ac-2cb1-4f40-8cf6-27e70ccaa9fb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.085236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 134/277] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:08.090369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a3bd-0155-47f0-a11f-426a919d8073 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.090369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a3bd-0155-47f0-a11f-426a919d8073 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.090369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404a3bd-0155-47f0-a11f-426a919d8073 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.090369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 135/278] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:08.090369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404a3bd-0155-47f0-a11f-426a919d8073 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.104119 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.153351 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 144/279] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:08.154350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b437e-b98c-4edb-a2b3-664d1d2d3527 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.173942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.206293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404a3bd-0155-47f0-a11f-426a919d8073 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.243007 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd53619-106a-4b38-b402-63eb914eea5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.243618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53619-106a-4b38-b402-63eb914eea5a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.243899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53619-106a-4b38-b402-63eb914eea5a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.244170 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd53619-106a-4b38-b402-63eb914eea5a None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.244836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53619-106a-4b38-b402-63eb914eea5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:08.245141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53619-106a-4b38-b402-63eb914eea5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.246675 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd53619-106a-4b38-b402-63eb914eea5a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.252030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b437e-b98c-4edb-a2b3-664d1d2d3527 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.255190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 136/280] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:08.256329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3a64-8c5d-49e4-a50c-a6597e616f58 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.256626 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3a64-8c5d-49e4-a50c-a6597e616f58 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.256883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78d3a64-8c5d-49e4-a50c-a6597e616f58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.274920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e78d3a64-8c5d-49e4-a50c-a6597e616f58 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:08.276317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e78d3a64-8c5d-49e4-a50c-a6597e616f58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:08.285250 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.285879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.286186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.286529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] PATH_INFO: `/v3/users/19beb71aa2a24ab6a18dfe74a4877eba` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.299180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] RBAC: Authorizing `identity:get_user(user_id=19beb71aa2a24ab6a18dfe74a4877eba)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.300628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.302253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 145/281] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/users/19beb71aa2a24ab6a18dfe74a4877eba => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:08.303005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.328018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.341312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 137/282] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:08.342263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d3a64-8c5d-49e4-a50c-a6597e616f58 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.405268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017ca9c2-3902-4d71-9dd5-9db880d3b436 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.413922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.438174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.438801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.439069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.439331 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.440758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.442270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.443829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 146/283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:08.444574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.453910 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78d3a64-8c5d-49e4-a50c-a6597e616f58 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.488080 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.488711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.488983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.489249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] PATH_INFO: `/v3/users/d599bc4cd1934c47bcc11f84799138e9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.490379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] RBAC: Authorizing `identity:get_user(user_id=d599bc4cd1934c47bcc11f84799138e9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.491816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.493411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 138/284] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/users/d599bc4cd1934c47bcc11f84799138e9 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:08.494182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.536386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.546004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d7bb7c-b960-4d96-8553-4b8bbd125307 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.581936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.582492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.582806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.583008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.583748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, user.id=19beb71aa2a24ab6a18dfe74a4877eba, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:08.584051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.585496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.590375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 147/285] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/role_assignments?user.id=19beb71aa2a24ab6a18dfe74a4877eba&scope.system=all&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 226 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:08.591142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.597544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3811fe-9e20-474d-b76d-c570a27460c5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.631921 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.639643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.640289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.640568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.640838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.653083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:08.658141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:08.659203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 139/286] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:08.660002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.730820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23205d99-e46e-4cf6-b87b-03265719bad0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.769872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.770655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.770933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.771315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.772011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.773464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.774429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633e2eb0-9388-41c7-aee5-673c3dedbe3f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.806092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 148/287] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:08 2022] POST /identity/v3/users => generated 293 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:08.806092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.826819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:08.828190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:08.828467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:08.828739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:08.829972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:08.831611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:08.833574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 140/288] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:08.839604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:08.911332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:08.954497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0232bc-d330-47c1-8080-95c26cb54054 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:08.970264 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce43390-6085-4ab8-ac6d-7ecee21dd75d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:09.001887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:09.002601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:09.003036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:09.003316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:09.004310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:09.004759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:09.006201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:09.016872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 149/289] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:09.017158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:09.019026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:09.019026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:09.019026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/d599bc4cd1934c47bcc11f84799138e9/roles/109c3809326c4439ae93c5f162b01640` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:09.022580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:09.022741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6225f957df243e4ac6c2de5b98355ff, user_id=d599bc4cd1934c47bcc11f84799138e9, role_id=109c3809326c4439ae93c5f162b01640)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:09.024308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:09.047210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 141/290] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:08 2022] PUT /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff/users/d599bc4cd1934c47bcc11f84799138e9/roles/109c3809326c4439ae93c5f162b01640 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:09.128979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:09.161988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12cc970-3134-44ae-89fb-f36d361062cd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:09.199566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:09.200225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:09.200505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:09.200781 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] PATH_INFO: `/v3/users/c09b7b0bd2944f34bbd684760e913ede` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:09.202108 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] RBAC: Authorizing `identity:get_user(user_id=c09b7b0bd2944f34bbd684760e913ede)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:09.203601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:09.205533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 150/291] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:09 2022] GET /identity/v3/users/c09b7b0bd2944f34bbd684760e913ede => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:09.211240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:09.329171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6ac7b-a6e3-468e-98ce-b6434ab2d815 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:09.348139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:09.368048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:09.368661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:09.368932 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:09.369256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:09.454902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:09.456266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:09.574831 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 142/292] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:09.580661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:09.727919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca476600-f96a-49a8-aeaf-f0264c9da8fd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:09.770188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97eaf0f6-a25a-4f36-8a64-333277d9284b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:09.770834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf0f6-a25a-4f36-8a64-333277d9284b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:09.771112 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf0f6-a25a-4f36-8a64-333277d9284b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:09.771382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97eaf0f6-a25a-4f36-8a64-333277d9284b None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:09.772521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf0f6-a25a-4f36-8a64-333277d9284b None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:09.774045 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97eaf0f6-a25a-4f36-8a64-333277d9284b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:09.775766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 151/293] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:09 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:09.781968 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:09.808480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:09.922729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42d0c4-bab9-4d3a-be00-6085f6d6b2b3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:09.974844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0f11c1-9fd1-48c2-b376-8c903e31f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:09.975457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f11c1-9fd1-48c2-b376-8c903e31f0b0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:09.975733 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f11c1-9fd1-48c2-b376-8c903e31f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:09.976003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0f11c1-9fd1-48c2-b376-8c903e31f0b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:09.976735 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f11c1-9fd1-48c2-b376-8c903e31f0b0 None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=c09b7b0bd2944f34bbd684760e913ede) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:09.977040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f11c1-9fd1-48c2-b376-8c903e31f0b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:09.978565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0f11c1-9fd1-48c2-b376-8c903e31f0b0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:09.985306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 143/294] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:09 2022] GET /identity/v3/role_assignments?user.id=c09b7b0bd2944f34bbd684760e913ede&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:10.820989 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394941-42f5-4730-afa0-5556a9a6ba8a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:10.821524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394941-42f5-4730-afa0-5556a9a6ba8a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:10.821802 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc394941-42f5-4730-afa0-5556a9a6ba8a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:10.823702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 152/295] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:10.829324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923fecf-56bd-43c8-874c-0a336784f173 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:10.829746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923fecf-56bd-43c8-874c-0a336784f173 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:10.830044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0923fecf-56bd-43c8-874c-0a336784f173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:10.848884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0923fecf-56bd-43c8-874c-0a336784f173 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:10.850095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0923fecf-56bd-43c8-874c-0a336784f173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:10.918774 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 144/296] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:10.941436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394941-42f5-4730-afa0-5556a9a6ba8a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:10.954819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.048450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc394941-42f5-4730-afa0-5556a9a6ba8a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.085952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:11.086535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.086814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.087092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.097891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:11.103134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:11.104000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:11.105172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 153/297] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:11.112398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923fecf-56bd-43c8-874c-0a336784f173 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.133390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.223926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0923fecf-56bd-43c8-874c-0a336784f173 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.262851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5dfc46-10fc-4784-a9e5-5b31020fc6d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:11.263468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfc46-10fc-4784-a9e5-5b31020fc6d5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.263744 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfc46-10fc-4784-a9e5-5b31020fc6d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.264019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5dfc46-10fc-4784-a9e5-5b31020fc6d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.264689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfc46-10fc-4784-a9e5-5b31020fc6d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:11.264983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfc46-10fc-4784-a9e5-5b31020fc6d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:11.266392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5dfc46-10fc-4784-a9e5-5b31020fc6d5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:11.275261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 145/298] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:11.280890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.305219 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f892-dfd3-4bf6-90bf-9ebbfd0ab71a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.305562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f892-dfd3-4bf6-90bf-9ebbfd0ab71a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.305768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2569f892-dfd3-4bf6-90bf-9ebbfd0ab71a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.307384 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 146/299] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:11.312538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e0e9c-062b-4240-9aa1-ae60f406948f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.312805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e0e9c-062b-4240-9aa1-ae60f406948f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.313074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4e0e9c-062b-4240-9aa1-ae60f406948f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.336579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1e4e0e9c-062b-4240-9aa1-ae60f406948f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:11.338476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1e4e0e9c-062b-4240-9aa1-ae60f406948f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:11.355494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.388310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f676d4f-0592-42e5-bf03-c2d6221ed769 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.413674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 147/300] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:11.415238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97985a9-d1b5-4669-beaf-b09308bb717b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.415652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97985a9-d1b5-4669-beaf-b09308bb717b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.416051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97985a9-d1b5-4669-beaf-b09308bb717b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.417434 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 148/301] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:11.423232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:11.423870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.424150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.424420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] PATH_INFO: `/v3/users/19beb71aa2a24ab6a18dfe74a4877eba` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.425598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] RBAC: Authorizing `identity:get_user(user_id=19beb71aa2a24ab6a18dfe74a4877eba)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:11.427094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:11.428802 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 154/302] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:11 2022] GET /identity/v3/users/19beb71aa2a24ab6a18dfe74a4877eba => generated 293 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:11.430194 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802eb2c-a2e3-4f15-97ff-cbaa4f49b2af None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.430451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802eb2c-a2e3-4f15-97ff-cbaa4f49b2af None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.430740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5802eb2c-a2e3-4f15-97ff-cbaa4f49b2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.437540 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.439087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.451568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5802eb2c-a2e3-4f15-97ff-cbaa4f49b2af None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:11.452837 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5802eb2c-a2e3-4f15-97ff-cbaa4f49b2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:11.522092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 149/303] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:11.523392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802eb2c-a2e3-4f15-97ff-cbaa4f49b2af None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.544042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f4def8-53ba-4832-8af2-4b37c1dc83eb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.580107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:11.580756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.581034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.581306 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] PATH_INFO: `/v3/system/users/19beb71aa2a24ab6a18dfe74a4877eba/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.582721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=19beb71aa2a24ab6a18dfe74a4877eba, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:11.584101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:11.593393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 155/304] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Aug 8 01:03:11 2022] PUT /identity/v3/system/users/19beb71aa2a24ab6a18dfe74a4877eba/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:03:11.594869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.598520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.645902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5802eb2c-a2e3-4f15-97ff-cbaa4f49b2af None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.689948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3d6531-9fd4-45bb-a57c-1ed39075dddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:11.690754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6531-9fd4-45bb-a57c-1ed39075dddb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.691038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6531-9fd4-45bb-a57c-1ed39075dddb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.691313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3d6531-9fd4-45bb-a57c-1ed39075dddb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.693532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.704910 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3d6531-9fd4-45bb-a57c-1ed39075dddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:11.710210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10dd47c7-2b04-4ca9-874b-46b578484b59 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3f3d6531-9fd4-45bb-a57c-1ed39075dddb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:11.710378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:11.711227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 150/305] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:11.712717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b4ea9-3474-434e-b29f-c7dec945aba3 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.713417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b4ea9-3474-434e-b29f-c7dec945aba3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.713417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790b4ea9-3474-434e-b29f-c7dec945aba3 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.718275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 151/306] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:11.718275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b4ea9-3474-434e-b29f-c7dec945aba3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.756974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6eddde-9bda-47e1-bcea-3630cd974c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:11.757620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eddde-9bda-47e1-bcea-3630cd974c0e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.757889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eddde-9bda-47e1-bcea-3630cd974c0e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.758191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6eddde-9bda-47e1-bcea-3630cd974c0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.760740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eddde-9bda-47e1-bcea-3630cd974c0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:11.762268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6eddde-9bda-47e1-bcea-3630cd974c0e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:11.764349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 156/307] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:11.765277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494043d-8485-4e33-8a86-9150b9de13e3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.765508 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494043d-8485-4e33-8a86-9150b9de13e3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.765775 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8494043d-8485-4e33-8a86-9150b9de13e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.783627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8494043d-8485-4e33-8a86-9150b9de13e3 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:11.784803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8494043d-8485-4e33-8a86-9150b9de13e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:11.832720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-790b4ea9-3474-434e-b29f-c7dec945aba3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.853816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.862547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 157/308] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:11.863634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494043d-8485-4e33-8a86-9150b9de13e3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.870863 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:11.871664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:11.872087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:11.872593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:11.873466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:11.873913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:11.875574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:11.886096 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 152/309] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:11.890090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:11.950116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:11.972533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8494043d-8485-4e33-8a86-9150b9de13e3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:11.995439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c914e0da-a60f-4159-826d-a4d8573d91e2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:12.007099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.007712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.007985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.008262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] PATH_INFO: `/v3/groups` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.008863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:12.010335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:12.028672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 158/310] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Aug 8 01:03:11 2022] POST /identity/v3/groups => generated 229 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:12.029520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:12.041549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.042726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.043215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.043687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.058937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:12.067402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:12.069689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:12.076333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 153/311] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:12.079725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:12.125126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:12.174970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac7d5d4-4057-4e49-ba96-2ef09e01235b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:12.213651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.215140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.215422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.215749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] PATH_INFO: `/v3/users/a3954f00b8bc4baaa088e23b99b59743` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.223441 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe568caa-250b-433a-bd17-84857b1ffa4a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:12.232670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] RBAC: Authorizing `identity:get_user(user_id=a3954f00b8bc4baaa088e23b99b59743)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:12.234456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:12.236447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 159/312] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:12 2022] GET /identity/v3/users/a3954f00b8bc4baaa088e23b99b59743 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:12.242915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:12.245559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:12.273408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.274886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.275101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.275472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.276401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:12.276800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:12.278309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:12.290374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 154/313] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:12.296288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:12.387673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ed2566-e75d-4708-9c1e-538e8279f39f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:12.406679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:12.410696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1d4554-0ac6-4766-80d7-42d36c449c3c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:12.425996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.426906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.426906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.427096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.427669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] RBAC: Adding query filter params (role.id=109c3809326c4439ae93c5f162b01640, user.id=a3954f00b8bc4baaa088e23b99b59743, scope.system=all) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:12.427976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:12.429434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:12.434921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 160/314] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Aug 8 01:03:12 2022] GET /identity/v3/role_assignments?user.id=a3954f00b8bc4baaa088e23b99b59743&scope.system=all&role.id=109c3809326c4439ae93c5f162b01640 => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:12.462543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.463516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.463926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.464327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] PATH_INFO: `/v3/users/d599bc4cd1934c47bcc11f84799138e9` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.465711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] RBAC: Authorizing `identity:get_user(user_id=d599bc4cd1934c47bcc11f84799138e9)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:12.467517 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:12.469740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 155/315] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:12 2022] GET /identity/v3/users/d599bc4cd1934c47bcc11f84799138e9 => generated 297 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:12.475625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:12.591118 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149518be-a3ab-4e0e-bf6b-ab2c044d0973 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:12.627577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.628438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.628846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.629244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.680869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:12.701636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:12.703484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:12.809179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 161/316] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:12.815898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:12.867025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:12.922366 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158d53fb-851b-4f2c-a8a9-6a324dbf98bd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:12.958762 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455915d8-a980-43e9-b870-0e922e26feb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:12.959308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455915d8-a980-43e9-b870-0e922e26feb3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:12.959589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455915d8-a980-43e9-b870-0e922e26feb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:12.959861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455915d8-a980-43e9-b870-0e922e26feb3 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:12.961052 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455915d8-a980-43e9-b870-0e922e26feb3 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:12.962544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455915d8-a980-43e9-b870-0e922e26feb3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:12.964482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 156/317] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:12 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:12.970251 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:13.055603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:13.074732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd749eab-d61b-4f09-b7e9-2ac6b378b42e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:13.114089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3933f0fd-e8da-4bc9-9481-06c03665f42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:13.114763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f0fd-e8da-4bc9-9481-06c03665f42e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:13.115039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f0fd-e8da-4bc9-9481-06c03665f42e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:13.115361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3933f0fd-e8da-4bc9-9481-06c03665f42e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:13.116116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f0fd-e8da-4bc9-9481-06c03665f42e None admin] RBAC: Adding query filter params (role.id=109c3809326c4439ae93c5f162b01640, scope.project.id=e6225f957df243e4ac6c2de5b98355ff, user.id=d599bc4cd1934c47bcc11f84799138e9) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:13.116428 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f0fd-e8da-4bc9-9481-06c03665f42e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:13.117874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3933f0fd-e8da-4bc9-9481-06c03665f42e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:13.124853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 162/318] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:12 2022] GET /identity/v3/role_assignments?user.id=d599bc4cd1934c47bcc11f84799138e9&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=109c3809326c4439ae93c5f162b01640 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:13.603786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44357877-010e-4f23-98bf-c050be3f5ac0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:13.604209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44357877-010e-4f23-98bf-c050be3f5ac0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:13.604307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44357877-010e-4f23-98bf-c050be3f5ac0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:13.605708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 157/319] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:13.611625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1775-fe14-42f8-b389-62f0c2a25b46 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:13.611877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1775-fe14-42f8-b389-62f0c2a25b46 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:13.612175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c1775-fe14-42f8-b389-62f0c2a25b46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:13.630819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-428c1775-fe14-42f8-b389-62f0c2a25b46 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:13.631995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-428c1775-fe14-42f8-b389-62f0c2a25b46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:13.707896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 163/320] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:13.730032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44357877-010e-4f23-98bf-c050be3f5ac0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:13.835637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44357877-010e-4f23-98bf-c050be3f5ac0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:13.850199 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:13.871263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:13.872561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:13.873004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:13.873504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:13.884072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:13.889313 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:13.890429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:13.891205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:13.891787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 158/321] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:13.898242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c1775-fe14-42f8-b389-62f0c2a25b46 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:13.977658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:14.003502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c1775-fe14-42f8-b389-62f0c2a25b46 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:14.037523 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a1c9b6-fce1-4856-9539-a65165daf949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:14.038507 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c9b6-fce1-4856-9539-a65165daf949 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.038973 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c9b6-fce1-4856-9539-a65165daf949 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.039419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a1c9b6-fce1-4856-9539-a65165daf949 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.040282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1c9b6-fce1-4856-9539-a65165daf949 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:14.040746 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1c9b6-fce1-4856-9539-a65165daf949 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:14.042420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a1c9b6-fce1-4856-9539-a65165daf949 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:14.055651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 164/322] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:14.056906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:14.129881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b864c7-e06b-4fb1-967d-40e97051ef83 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.130495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b864c7-e06b-4fb1-967d-40e97051ef83 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.130944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b864c7-e06b-4fb1-967d-40e97051ef83 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.132341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 165/323] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:14.137632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57bd7-d83d-489c-a503-6d6fa9cb5da5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.137913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57bd7-d83d-489c-a503-6d6fa9cb5da5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.138471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c57bd7-d83d-489c-a503-6d6fa9cb5da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.157652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a3c57bd7-d83d-489c-a503-6d6fa9cb5da5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:14.158880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3c57bd7-d83d-489c-a503-6d6fa9cb5da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:14.178078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56329efe-42ab-40f5-8173-3b498b04f3d6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:14.213330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:14.213960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.214268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.214530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] PATH_INFO: `/v3/users/19beb71aa2a24ab6a18dfe74a4877eba` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.215648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] RBAC: Authorizing `identity:get_user(user_id=19beb71aa2a24ab6a18dfe74a4877eba)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:14.217151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:14.219294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 159/324] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:14 2022] GET /identity/v3/users/19beb71aa2a24ab6a18dfe74a4877eba => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:14.224698 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:14.231468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 166/325] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:14.254347 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c57bd7-d83d-489c-a503-6d6fa9cb5da5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:14.269090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:14.324329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:14.327894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7617dd1-4e0e-46a7-a5ee-72262ef5bb18 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:14.360183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c57bd7-d83d-489c-a503-6d6fa9cb5da5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:14.362475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:14.363081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.363354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.363623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.364340 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] RBAC: Adding query filter params (role.id=ec37613f9e804c21b03ddafcb4c445f5, user.id=19beb71aa2a24ab6a18dfe74a4877eba, scope.system=all) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:14.364638 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:14.366146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:14.379192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 160/326] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Aug 8 01:03:14 2022] GET /identity/v3/role_assignments?user.id=19beb71aa2a24ab6a18dfe74a4877eba&scope.system=all&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 510 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:14.393678 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74b6bf8-97ae-498d-a88d-fc15838a636c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:14.394279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b6bf8-97ae-498d-a88d-fc15838a636c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.394553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b6bf8-97ae-498d-a88d-fc15838a636c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.394820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74b6bf8-97ae-498d-a88d-fc15838a636c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.396025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b6bf8-97ae-498d-a88d-fc15838a636c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:14.397520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74b6bf8-97ae-498d-a88d-fc15838a636c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:14.399393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 167/327] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:14.405674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:14.487599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274d905-233f-4e6d-9e63-00db5b58d2d9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.488287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274d905-233f-4e6d-9e63-00db5b58d2d9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.488560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6274d905-233f-4e6d-9e63-00db5b58d2d9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.490106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 168/328] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:14.495558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed55f0-86e0-4085-b2b8-fdad184c4bad None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.495869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed55f0-86e0-4085-b2b8-fdad184c4bad None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.496118 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ed55f0-86e0-4085-b2b8-fdad184c4bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.515273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f9ed55f0-86e0-4085-b2b8-fdad184c4bad None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:14.516500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f9ed55f0-86e0-4085-b2b8-fdad184c4bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:14.516703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:14.520982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a31836-3a98-4445-8e5f-8a39175744c7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:14.560069 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:14.560676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.561042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.564017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] PATH_INFO: `/v3/groups` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.564017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:14.564017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:14.586579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 161/329] 10.222.0.39 () {60 vars in 1134 bytes} [Mon Aug 8 01:03:14 2022] POST /identity/v3/groups => generated 226 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:14.604116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 169/330] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:14.626547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:14.734535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a87b96b-f84c-4558-ad6f-5ae2ff005f6e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:14.770493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:14.771122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.771402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.771666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.795483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:14.800716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:14.801730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:14.802561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 162/331] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:14 2022] GET /identity/v3/roles/reader => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:14.808005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed55f0-86e0-4085-b2b8-fdad184c4bad None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:14.879885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:14.918605 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ed55f0-86e0-4085-b2b8-fdad184c4bad None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:14.954916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:14.955532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:14.955809 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:14.956080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:14.956752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] RBAC: Adding query filter params (name=reader) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:14.957050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:14.958610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:14.968852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 170/332] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:14 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:14.974309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:15.003604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:15.092706 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e92ae53-8e66-45fe-80b6-91f45fa0004d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:15.147131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54b60f7-5d53-4671-a6e6-8871bf601600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:15.147785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b60f7-5d53-4671-a6e6-8871bf601600 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:15.148065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b60f7-5d53-4671-a6e6-8871bf601600 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:15.148345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54b60f7-5d53-4671-a6e6-8871bf601600 None admin] PATH_INFO: `/v3/users/a3954f00b8bc4baaa088e23b99b59743` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:15.149494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b60f7-5d53-4671-a6e6-8871bf601600 None admin] RBAC: Authorizing `identity:get_user(user_id=a3954f00b8bc4baaa088e23b99b59743)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:15.150993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54b60f7-5d53-4671-a6e6-8871bf601600 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:15.152911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 163/333] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:14 2022] GET /identity/v3/users/a3954f00b8bc4baaa088e23b99b59743 => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:15.158825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:15.276290 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6398255e-855e-46f0-8057-e08813af1d2e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:15.306418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:15.315393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ab838-ae52-4541-a320-7e8df851c379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:15.316064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ab838-ae52-4541-a320-7e8df851c379 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:15.316344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ab838-ae52-4541-a320-7e8df851c379 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:15.316621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ab838-ae52-4541-a320-7e8df851c379 None admin] PATH_INFO: `/v3/system/users/a3954f00b8bc4baaa088e23b99b59743/roles/109c3809326c4439ae93c5f162b01640` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:15.318090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ab838-ae52-4541-a320-7e8df851c379 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a3954f00b8bc4baaa088e23b99b59743, role_id=109c3809326c4439ae93c5f162b01640)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:15.319493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ab838-ae52-4541-a320-7e8df851c379 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:15.335387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 171/334] 10.222.0.39 () {58 vars in 1334 bytes} [Mon Aug 8 01:03:15 2022] PUT /identity/v3/system/users/a3954f00b8bc4baaa088e23b99b59743/roles/109c3809326c4439ae93c5f162b01640 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:17.061644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dfeb2-165a-48ba-b6c2-7850773e370e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.062195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dfeb2-165a-48ba-b6c2-7850773e370e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.062276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9dfeb2-165a-48ba-b6c2-7850773e370e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.063837 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 164/335] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:17.069464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40820-36f4-4ec9-92ca-e7dbab17aa4f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.069902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40820-36f4-4ec9-92ca-e7dbab17aa4f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.070041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d40820-36f4-4ec9-92ca-e7dbab17aa4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.093946 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b4d40820-36f4-4ec9-92ca-e7dbab17aa4f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:17.095216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b4d40820-36f4-4ec9-92ca-e7dbab17aa4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:17.181344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 172/336] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:17.214688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dfeb2-165a-48ba-b6c2-7850773e370e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:17.331245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:17.347051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9dfeb2-165a-48ba-b6c2-7850773e370e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:17.381891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc58d517-a117-4d11-865b-0e8d1522b40e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:17.382554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d517-a117-4d11-865b-0e8d1522b40e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.382829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d517-a117-4d11-865b-0e8d1522b40e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.383095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc58d517-a117-4d11-865b-0e8d1522b40e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.398913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc58d517-a117-4d11-865b-0e8d1522b40e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fc58d517-a117-4d11-865b-0e8d1522b40e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:17.404216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:17.405168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:17.405957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 165/337] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:17.411799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d40820-36f4-4ec9-92ca-e7dbab17aa4f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:17.430734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a006-c60d-4311-a001-bc437ea89e99 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.431060 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a006-c60d-4311-a001-bc437ea89e99 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.431274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2280a006-c60d-4311-a001-bc437ea89e99 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.432609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 166/338] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:17.440426 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8610-d0d8-4617-a59d-9f1c681acc6a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.440708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8610-d0d8-4617-a59d-9f1c681acc6a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.440980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7d8610-d0d8-4617-a59d-9f1c681acc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.472648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ad7d8610-d0d8-4617-a59d-9f1c681acc6a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:17.473875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ad7d8610-d0d8-4617-a59d-9f1c681acc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:17.589602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 167/339] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:17.590878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bfa7f-90ec-43b7-9077-759e36381d2f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.591163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bfa7f-90ec-43b7-9077-759e36381d2f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.591434 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80bfa7f-90ec-43b7-9077-759e36381d2f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.593406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 168/340] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:17.606661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d40820-36f4-4ec9-92ca-e7dbab17aa4f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:17.617720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26563-7799-43c0-8fe2-ac2ba50d070d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.618005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26563-7799-43c0-8fe2-ac2ba50d070d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.618297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf26563-7799-43c0-8fe2-ac2ba50d070d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.650027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-eaf26563-7799-43c0-8fe2-ac2ba50d070d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:17.651238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-eaf26563-7799-43c0-8fe2-ac2ba50d070d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:17.658390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:17.685080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:17.685794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.686088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.686359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.687034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:17.687326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:17.688704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:17.709996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 173/341] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:17.710692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:17.754482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 169/342] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:17.755414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf26563-7799-43c0-8fe2-ac2ba50d070d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:17.774124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:17.889816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d64cb5-8543-43ca-9823-87efda020b8e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:17.927056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf26563-7799-43c0-8fe2-ac2ba50d070d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:17.967241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:17.968254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.968794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.969261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:17.974780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:17.975435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:17.975715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:17.975991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:18.015278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:18.016203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:18.017006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:18.021658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 174/343] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:18.025983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:18.099990 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:18.105896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:18.138992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:18.140989 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:18.243356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809bd70-2cc4-432e-8e96-0fe8c60f2897 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:18.282089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:18.282774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.283059 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.283333 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.298903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:18.304645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:18.305549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:18.306384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:18.308027 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 175/344] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:18.308846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:18.392314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 170/345] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:18.393521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:18.427179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ac3c8-a254-4a96-b1dc-87af93406a67 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:18.430360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:18.471673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:18.472305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.472586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.472862 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.473833 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:18.474167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:18.476389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:18.489571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 176/346] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:18.489847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:18.550551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21cbcea-5bc4-4539-8ca8-057362eadf13 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:18.563241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:18.598722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04da298a-9835-49ad-9460-c02c96601029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:18.599488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da298a-9835-49ad-9460-c02c96601029 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.599768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da298a-9835-49ad-9460-c02c96601029 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.600029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04da298a-9835-49ad-9460-c02c96601029 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.601335 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da298a-9835-49ad-9460-c02c96601029 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:18.601661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da298a-9835-49ad-9460-c02c96601029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:18.603207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04da298a-9835-49ad-9460-c02c96601029 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:18.613277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 171/347] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:18.614563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484f0f-39c0-49a1-8ad2-c85359348aef None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.614838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484f0f-39c0-49a1-8ad2-c85359348aef None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.615107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37484f0f-39c0-49a1-8ad2-c85359348aef None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.616351 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 172/348] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:18.621030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484f0f-39c0-49a1-8ad2-c85359348aef None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:18.625650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de1b953-d2f0-4863-bd26-66c3fccbdd69 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:18.670441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69886df2-ff16-476e-a860-85efe475e35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:18.671439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886df2-ff16-476e-a860-85efe475e35a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.671905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886df2-ff16-476e-a860-85efe475e35a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.672361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69886df2-ff16-476e-a860-85efe475e35a None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.673701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886df2-ff16-476e-a860-85efe475e35a None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:18.675402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69886df2-ff16-476e-a860-85efe475e35a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:18.677556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 177/349] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:18 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:18.681339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89e5f-ab43-4883-8f35-cd735ce6b713 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.681621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89e5f-ab43-4883-8f35-cd735ce6b713 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.681940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a89e5f-ab43-4883-8f35-cd735ce6b713 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.683694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 178/350] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:18.684451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a89e5f-ab43-4883-8f35-cd735ce6b713 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:18.728458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:18.750097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37484f0f-39c0-49a1-8ad2-c85359348aef None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:18.791214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccb199a-e446-4d55-90f1-6d9306028635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:18.791669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb199a-e446-4d55-90f1-6d9306028635 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.793833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb199a-e446-4d55-90f1-6d9306028635 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.793833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccb199a-e446-4d55-90f1-6d9306028635 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.818179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a89e5f-ab43-4883-8f35-cd735ce6b713 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:18.850885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:18.871393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:18.872008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:18.872286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:18.872553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:18.900772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb199a-e446-4d55-90f1-6d9306028635 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:18.902253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccb199a-e446-4d55-90f1-6d9306028635 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:18.954651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:18.956039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:18.996785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.033709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 173/351] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:19.033709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641595-c253-4048-9fe9-3f15f684b9bc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.033709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641595-c253-4048-9fe9-3f15f684b9bc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.033709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52641595-c253-4048-9fe9-3f15f684b9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.050617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-52641595-c253-4048-9fe9-3f15f684b9bc None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:19.051810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-52641595-c253-4048-9fe9-3f15f684b9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:19.075087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 179/352] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:19.076164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.139074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.146570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 174/353] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:19.147924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0b980-934a-4850-9860-505f394d42d3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.148257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0b980-934a-4850-9860-505f394d42d3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.148526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c0b980-934a-4850-9860-505f394d42d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.169558 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-81c0b980-934a-4850-9860-505f394d42d3 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:19.170983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-81c0b980-934a-4850-9860-505f394d42d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:19.203574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f5b6a7-b22e-4c03-ad76-e5045c77c544 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.241071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed3813-c0ec-40b4-862b-c700f101bc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.241721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3813-c0ec-40b4-862b-c700f101bc2a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.241999 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3813-c0ec-40b4-862b-c700f101bc2a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.242301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed3813-c0ec-40b4-862b-c700f101bc2a None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.244912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.250916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed3813-c0ec-40b4-862b-c700f101bc2a None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:19.252392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ed3813-c0ec-40b4-862b-c700f101bc2a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:19.261055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 180/354] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:19.261055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677af5-ab9b-4d07-bb62-8a1e1d5a02ca None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.261055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677af5-ab9b-4d07-bb62-8a1e1d5a02ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.261055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f677af5-ab9b-4d07-bb62-8a1e1d5a02ca None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.261055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 181/355] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:19.261055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677af5-ab9b-4d07-bb62-8a1e1d5a02ca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.261584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 175/356] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:19.261584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0b980-934a-4850-9860-505f394d42d3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.371433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c0b980-934a-4850-9860-505f394d42d3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.384853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f677af5-ab9b-4d07-bb62-8a1e1d5a02ca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.407537 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.414767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.415401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.415681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.415954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.417068 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:19.418627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:19.420755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 176/357] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:19.422197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.426422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105bda3d-be84-4cf4-86fa-f4271cfe9f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.427093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bda3d-be84-4cf4-86fa-f4271cfe9f10 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.427368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bda3d-be84-4cf4-86fa-f4271cfe9f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.427635 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105bda3d-be84-4cf4-86fa-f4271cfe9f10 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.428988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bda3d-be84-4cf4-86fa-f4271cfe9f10 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:19.430208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105bda3d-be84-4cf4-86fa-f4271cfe9f10 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:19.431841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 182/358] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:19.433045 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508ff1-609d-403b-ba74-4d08f0cc6872 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.433318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508ff1-609d-403b-ba74-4d08f0cc6872 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.433583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f508ff1-609d-403b-ba74-4d08f0cc6872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.453675 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1f508ff1-609d-403b-ba74-4d08f0cc6872 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:19.454987 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1f508ff1-609d-403b-ba74-4d08f0cc6872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:19.524413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.536277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 183/359] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:19.537484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508ff1-609d-403b-ba74-4d08f0cc6872 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.548415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f297f9c3-397d-4d5e-8603-8f911008749f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.587409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.588611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.588611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.588611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.601876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:19.606691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:19.607608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:19.608594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 177/360] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:19.609252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.667985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f508ff1-609d-403b-ba74-4d08f0cc6872 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.678964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.716183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.716795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.717388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.717662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.718438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=5eed008ec382415094a2620db0a75891) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:19.718745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:19.720213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:19.730209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 184/361] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:19.730718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae68856-8388-44d7-bac7-eb83f202fd74 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.731158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.781739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.782345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.782617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.782886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.799658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:19.805120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:19.810725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 178/362] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:19.811574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.824958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.875143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5518bf96-1c71-4cf5-9f41-746eb613ccc5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.919017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.919660 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.919951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.920293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.921603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:19.923097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:19.924864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 185/363] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:19.925468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:19.946365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09311e0-3bd8-4335-9cf6-033c95d21789 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:19.968605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:19.996254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:19.996902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:19.997181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:19.997454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:19.998674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.000227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.002006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 179/364] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:20.002672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.052735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fa062-c267-4d3e-83bb-5ea0c25462ca None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.084181 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:20.100502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.101414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.101694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.101964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.116738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:20.123578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:20.124447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:20.125245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 186/365] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:20.126906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08a91b4-437d-404a-9c88-b556189b0429 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.131559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.164748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.165365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.165630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.165899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.166611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:20.166911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.168275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.177622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 180/366] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:20.178925 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.231452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:20.246552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5703576b-00b0-4623-86ac-b9a4cab65f24 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.283239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.284157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.284614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.285061 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.285193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf184be-4003-4f4a-a042-84e44cb75b03 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.286031 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:20.286537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.288116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.296521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 187/367] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:20.297615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.326328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.327416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.327701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.327977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.328707 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=0167dcf165304e1390fd26c235128524, scope.project.id=5eed008ec382415094a2620db0a75891) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:20.329016 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.330483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.344081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 181/368] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=0167dcf165304e1390fd26c235128524 => generated 260 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:20.344081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.357618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:20.419113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376bc49-3e9e-4fb8-bb61-f46f4890b377 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.459314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.460137 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.460514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.460883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.461848 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=e6225f957df243e4ac6c2de5b98355ff) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:20.462299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.464042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.466301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20dcdcac-bdc8-458f-a88a-7e8fc85baab7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.477322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 188/369] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:20.477322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.500324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:20.527183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.527833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.528113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.528384 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.529183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:20.529731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.531379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.542867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 182/370] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:20.543830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.611062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42b5bbe-e623-473e-9479-baa38dce2aa4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.626709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:20.650234 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.651276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.651850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.652339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] PATH_INFO: `/v3/users/a3954f00b8bc4baaa088e23b99b59743` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.653792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] RBAC: Authorizing `identity:get_user(user_id=a3954f00b8bc4baaa088e23b99b59743)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.655638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.657881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 189/371] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/users/a3954f00b8bc4baaa088e23b99b59743 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:20.658881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:20.659922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8853eb79-236a-4b87-bc8a-b364824d25c7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.698880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.699511 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.699791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.700059 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.747542 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:20.771260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b41d0-017b-412d-bcee-3e4d5b840e5b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:20.776168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.777650 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.808403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:20.809487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:20.810103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:20.810724 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:20.866475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:20.895597 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:20.897807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:20.899215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 183/372] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:20.900223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:21.005263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:21.024513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 190/373] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:21.025736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:21.059007 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991da7ff-d994-44a3-843a-958d6e63cddb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:21.131627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:21.132500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:21.133131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.133405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.133664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.134421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] RBAC: Adding query filter params (role.id=109c3809326c4439ae93c5f162b01640, user.id=a3954f00b8bc4baaa088e23b99b59743, scope.system=all) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:21.134725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:21.136167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:21.153128 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574173c7-145d-4955-9a79-9ecc64a39b58 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:21.165715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 184/374] 10.222.0.39 () {56 vars in 1308 bytes} [Mon Aug 8 01:03:20 2022] GET /identity/v3/role_assignments?user.id=a3954f00b8bc4baaa088e23b99b59743&scope.system=all&role.id=109c3809326c4439ae93c5f162b01640 => generated 510 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:21.166671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:21.202955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:21.203617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.203896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.204665 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.207369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:21.208862 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:21.210863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 191/375] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:21 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:21.218259 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:21.371369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653cff71-e98a-494f-8e86-56160b328851 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:21.403407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c61ac-b485-415f-9f91-2398776bad8b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:21.433822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:21.444396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:21.445109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.445386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.445701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] PATH_INFO: `/v3/projects/1076d8c1402c4204a0e2862514393b33` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.446969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] RBAC: Authorizing `identity:get_project(project_id=1076d8c1402c4204a0e2862514393b33)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:21.448417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:21.452352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 185/376] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:21 2022] GET /identity/v3/projects/1076d8c1402c4204a0e2862514393b33 => generated 344 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:21.456533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:21.473262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:21.473919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.474230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.474557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.476044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:21.480033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:21.484557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 192/377] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:21 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:21.490114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:21.527843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:21.635293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec07f1c-b182-4d75-9f8a-9f9732fb345e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:21.662297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8e2c52-0df4-46c8-be20-2aa1307795fb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:21.680276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:21.681486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.681938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.682535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.683735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=0167dcf165304e1390fd26c235128524, scope.project.id=e6225f957df243e4ac6c2de5b98355ff) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:21.684230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:21.685929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:21.695851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 193/378] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:21 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=0167dcf165304e1390fd26c235128524 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:21.714963 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d356d-8028-4536-91d3-16a5144b7594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:21.715635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d356d-8028-4536-91d3-16a5144b7594 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.716198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d356d-8028-4536-91d3-16a5144b7594 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.716472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d356d-8028-4536-91d3-16a5144b7594 None admin] PATH_INFO: `/v3/groups/5c0c92873930495593ddb5cf4a048557` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.726719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d356d-8028-4536-91d3-16a5144b7594 None admin] RBAC: Authorizing `identity:get_group(group_id=5c0c92873930495593ddb5cf4a048557)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:21.728538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d356d-8028-4536-91d3-16a5144b7594 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:21.730720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 186/379] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:21 2022] GET /identity/v3/groups/5c0c92873930495593ddb5cf4a048557 => generated 229 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:21.738019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:21.837831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:21.858916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f198f3-45f1-49ae-ad9b-83b4f799db56 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:21.897386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:21.898392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.898898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.899390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.900324 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] RBAC: Adding query filter params (group.id=5c0c92873930495593ddb5cf4a048557, role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=1076d8c1402c4204a0e2862514393b33) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:21.900832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:21.902509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:21.909382 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c70f-f1d7-4d2c-8990-aeb3b85385e6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.910008 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c70f-f1d7-4d2c-8990-aeb3b85385e6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.910518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c06c70f-f1d7-4d2c-8990-aeb3b85385e6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.912034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 187/380] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:21.913812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 194/381] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:21 2022] GET /identity/v3/role_assignments?group.id=5c0c92873930495593ddb5cf4a048557&scope.project.id=1076d8c1402c4204a0e2862514393b33&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:21.920276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d9e73-7703-4ff7-8e43-53f512e2bb30 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:21.920276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d9e73-7703-4ff7-8e43-53f512e2bb30 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:21.920603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5d9e73-7703-4ff7-8e43-53f512e2bb30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:21.941405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9c5d9e73-7703-4ff7-8e43-53f512e2bb30 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:21.942767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9c5d9e73-7703-4ff7-8e43-53f512e2bb30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:22.011405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:22.028960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 188/382] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:22.063943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:22.230905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96490c40-7492-4f4f-bde1-4a3d49cd3c37 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:22.276122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:22.276122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:22.276122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:22.276122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:22.295330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:22.300589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:22.301884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:22.303078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 195/383] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:22.310032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d9e73-7703-4ff7-8e43-53f512e2bb30 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:22.432814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5d9e73-7703-4ff7-8e43-53f512e2bb30 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:22.476004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:22.476627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:22.476907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:22.477182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:22.477857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] RBAC: Adding query filter params (name=member) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:22.478176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:22.479546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:22.493934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 189/384] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:22.499891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:22.508956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:22.635252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ca7183-ce99-4b81-834d-d299173aebc9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:22.682956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:22.683988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:22.684458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:22.684917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:22.690757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:22.692517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:22.694735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 196/385] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:22 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:22.700535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:22.793856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:22.850044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988404f-c057-4fd4-ba4b-ce3ab32bb81c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:22.890211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e538830-53ab-418a-a844-f018295e433e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:22.890868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538830-53ab-418a-a844-f018295e433e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:22.891147 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538830-53ab-418a-a844-f018295e433e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:22.891418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e538830-53ab-418a-a844-f018295e433e None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:22.898767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e538830-53ab-418a-a844-f018295e433e None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:22.900243 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e538830-53ab-418a-a844-f018295e433e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:22.902135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 190/386] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:22 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:22.908519 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:23.044209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:23.078388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e194d94e-3451-496b-8ec0-c39add32468a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:23.134175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab57e86a-eb5f-4131-9630-8d9831c47687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:23.135258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57e86a-eb5f-4131-9630-8d9831c47687 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.135527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57e86a-eb5f-4131-9630-8d9831c47687 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.135799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab57e86a-eb5f-4131-9630-8d9831c47687 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891/groups/cfeab76c43b241e280dff34a241b09fe/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.143306 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57e86a-eb5f-4131-9630-8d9831c47687 None admin] RBAC: Authorizing `identity:create_grant(project_id=5eed008ec382415094a2620db0a75891, group_id=cfeab76c43b241e280dff34a241b09fe, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:23.144774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab57e86a-eb5f-4131-9630-8d9831c47687 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:23.179249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 197/387] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Aug 8 01:03:22 2022] PUT /identity/v3/projects/5eed008ec382415094a2620db0a75891/groups/cfeab76c43b241e280dff34a241b09fe/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:23.290639 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3561d4-71aa-4a5a-9ff7-1cdc6f8e0b99 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.290996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3561d4-71aa-4a5a-9ff7-1cdc6f8e0b99 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.291196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3561d4-71aa-4a5a-9ff7-1cdc6f8e0b99 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.292723 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 191/388] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:23.298305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d58d45-f86a-4d9d-b22e-c14759603594 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.298572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d58d45-f86a-4d9d-b22e-c14759603594 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.298787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d58d45-f86a-4d9d-b22e-c14759603594 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.315604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452acb-bf61-4830-a68c-ff7b9db05196 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.316159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452acb-bf61-4830-a68c-ff7b9db05196 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.316159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05452acb-bf61-4830-a68c-ff7b9db05196 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.317617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 192/389] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:23.323644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe75e8-e458-4a29-b39b-3307b0063fad None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.323927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe75e8-e458-4a29-b39b-3307b0063fad None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.324210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe75e8-e458-4a29-b39b-3307b0063fad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.328718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d4d58d45-f86a-4d9d-b22e-c14759603594 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:23.330269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d4d58d45-f86a-4d9d-b22e-c14759603594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:23.351571 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bebe75e8-e458-4a29-b39b-3307b0063fad None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:23.353276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bebe75e8-e458-4a29-b39b-3307b0063fad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:23.428334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 198/390] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:23.450674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 193/391] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:23.462435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d58d45-f86a-4d9d-b22e-c14759603594 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:23.475855 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe75e8-e458-4a29-b39b-3307b0063fad None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:23.576435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:23.577181 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:23.615006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d58d45-f86a-4d9d-b22e-c14759603594 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:23.651275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:23.652007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.652291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.652567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.663368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:23.668173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:23.669168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:23.669993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 199/392] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:23.675639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:23.740971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe75e8-e458-4a29-b39b-3307b0063fad None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:23.809014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:23.809757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.810098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.810805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.834683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:23.835824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8cdd92-1f5f-4935-b170-a935ea5889fd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:23.842525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:23.843436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:23.844235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 194/393] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 368 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:23.850690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:23.866470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:23.882746 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:23.883370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:23.883650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:23.883925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:23.884604 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:23.884908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:23.888504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:23.907178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 200/394] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:23.913080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.053262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2751cbf-9bac-4d4f-8c0a-f1aeef0af269 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.078628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:24.101556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b66f759-c580-46fe-a877-c675e54f9e83 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.127318 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.127950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.128224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.128494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.129173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:24.129594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:24.131013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:24.149239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 195/395] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:24.159240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.163490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.164383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.164868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.165337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.166672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:24.169166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:24.171565 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 201/396] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:23 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:24.179745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.305037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:24.321584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3c1fc0-fbda-46a5-8312-8a372b081a20 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.370994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87eef9f-979b-4dd7-a70e-1b230840850d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.371552 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eef9f-979b-4dd7-a70e-1b230840850d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.371823 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eef9f-979b-4dd7-a70e-1b230840850d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.372088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87eef9f-979b-4dd7-a70e-1b230840850d None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.374234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eef9f-979b-4dd7-a70e-1b230840850d None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:24.375675 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87eef9f-979b-4dd7-a70e-1b230840850d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:24.377261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 196/397] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:24 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:24.379140 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c5a1-2b43-4918-9344-d96579d25c21 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.379420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c5a1-2b43-4918-9344-d96579d25c21 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.379792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a86c5a1-2b43-4918-9344-d96579d25c21 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.381339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 197/398] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:24.385729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c5a1-2b43-4918-9344-d96579d25c21 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.386563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcb7441-c41e-4b4d-9683-f2fd68834642 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.427823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271b5ea9-89f4-4873-bf7e-4cbde9feff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.428571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5ea9-89f4-4873-bf7e-4cbde9feff40 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.428859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5ea9-89f4-4873-bf7e-4cbde9feff40 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.429117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271b5ea9-89f4-4873-bf7e-4cbde9feff40 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.430258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5ea9-89f4-4873-bf7e-4cbde9feff40 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:24.431710 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271b5ea9-89f4-4873-bf7e-4cbde9feff40 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:24.433344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 202/399] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:24 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:24.434599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd39a-f87a-4dc2-a839-f095ce43d02c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.434881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd39a-f87a-4dc2-a839-f095ce43d02c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.435149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cd39a-f87a-4dc2-a839-f095ce43d02c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.436907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:24.455387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1d0cd39a-f87a-4dc2-a839-f095ce43d02c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:24.456590 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1d0cd39a-f87a-4dc2-a839-f095ce43d02c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:24.502090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a86c5a1-2b43-4918-9344-d96579d25c21 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.540106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf64b60-ae9f-4bce-b8ba-ad615ec0d2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.540844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64b60-ae9f-4bce-b8ba-ad615ec0d2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.541187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64b60-ae9f-4bce-b8ba-ad615ec0d2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.541533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf64b60-ae9f-4bce-b8ba-ad615ec0d2d6 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.542310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 203/400] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:24.542873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf64b60-ae9f-4bce-b8ba-ad615ec0d2d6 None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:24.543481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bec34-30ea-4dbe-bf5d-d7b13309ca43 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.543765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bec34-30ea-4dbe-bf5d-d7b13309ca43 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.544033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978bec34-30ea-4dbe-bf5d-d7b13309ca43 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.544576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf64b60-ae9f-4bce-b8ba-ad615ec0d2d6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:24.549438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 204/401] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:24.549438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bec34-30ea-4dbe-bf5d-d7b13309ca43 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.552300 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 198/402] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:24 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:24.553450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184306d-2c60-4d4c-af1b-926e7c35ee6b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.553741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184306d-2c60-4d4c-af1b-926e7c35ee6b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.554016 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f184306d-2c60-4d4c-af1b-926e7c35ee6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.573551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f184306d-2c60-4d4c-af1b-926e7c35ee6b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:24.574783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f184306d-2c60-4d4c-af1b-926e7c35ee6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:24.619894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:24.650282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 199/403] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:24.651115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184306d-2c60-4d4c-af1b-926e7c35ee6b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.685078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978bec34-30ea-4dbe-bf5d-d7b13309ca43 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.695448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:24.722323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.722984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.723263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.723536 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff/groups/cfeab76c43b241e280dff34a241b09fe/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.725425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6225f957df243e4ac6c2de5b98355ff, group_id=cfeab76c43b241e280dff34a241b09fe, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:24.726894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:24.741273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 205/404] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Aug 8 01:03:24 2022] PUT /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff/groups/cfeab76c43b241e280dff34a241b09fe/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:24.747201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.761263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f184306d-2c60-4d4c-af1b-926e7c35ee6b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.806095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.807437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.807437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.807816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891/groups/cfeab76c43b241e280dff34a241b09fe/roles/0167dcf165304e1390fd26c235128524` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.812390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] RBAC: Authorizing `identity:create_grant(project_id=5eed008ec382415094a2620db0a75891, group_id=cfeab76c43b241e280dff34a241b09fe, role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:24.814010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:24.843182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 200/405] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Aug 8 01:03:24 2022] PUT /identity/v3/projects/5eed008ec382415094a2620db0a75891/groups/cfeab76c43b241e280dff34a241b09fe/roles/0167dcf165304e1390fd26c235128524 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:24.844564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:24.884959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf5a277-3b24-48c0-ad3b-fe4050acab99 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:24.911923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:24.941800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:24.942511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:24.942785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:24.943056 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:24.961828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:24.967100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:24.968165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:24.969147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:24.969899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 206/406] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:24.975535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.017383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c1a177-87a0-431e-93eb-c4fb5096f768 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.020122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:25.070169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.071372 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.071800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.072371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.084727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:25.088682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baa8bd0-ac40-42d2-b228-c4f43235244a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:25.090296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:25.091355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:25.092593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:25.094630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 201/407] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:25.104114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.145307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.147410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.147857 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.148935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.149750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:25.150830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:25.152517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:25.164075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 207/408] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:25.183987 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.235395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1aecde-58ee-498b-9f21-76254d22c03f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.271484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.272260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.272930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.273303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.274103 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:25.274513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:25.275992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:25.285401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 202/409] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:25.288081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:25.291816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.324086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:25.411818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b42ebc-ff7d-4bae-8f2a-4ede8eea667b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.414900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb4bd57-eef1-4778-9cab-3d8cf20275d7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.456900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.458153 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.458907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.459773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.461536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:25.463703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:25.464224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8dbaed-0d36-494f-b68f-2a81e66f0fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.464929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbaed-0d36-494f-b68f-2a81e66f0fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.465377 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbaed-0d36-494f-b68f-2a81e66f0fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.465716 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8dbaed-0d36-494f-b68f-2a81e66f0fa0 None admin] PATH_INFO: `/v3/groups/5c0c92873930495593ddb5cf4a048557` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.466815 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 203/410] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:25 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:25.466968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dbaed-0d36-494f-b68f-2a81e66f0fa0 None admin] RBAC: Authorizing `identity:get_group(group_id=5c0c92873930495593ddb5cf4a048557)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:25.468855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc8dbaed-0d36-494f-b68f-2a81e66f0fa0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:25.475404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 208/411] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:25 2022] GET /identity/v3/groups/5c0c92873930495593ddb5cf4a048557 => generated 229 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:25.476244 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.481078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199628-db49-4fc4-becc-3365059a6d46 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.481603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199628-db49-4fc4-becc-3365059a6d46 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.482201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87199628-db49-4fc4-becc-3365059a6d46 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.484077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 209/412] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:25.489541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b0208-a87a-426f-98ac-470bfa46fa4c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.490119 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b0208-a87a-426f-98ac-470bfa46fa4c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.490763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3b0208-a87a-426f-98ac-470bfa46fa4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.510088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ee3b0208-a87a-426f-98ac-470bfa46fa4c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:25.511696 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ee3b0208-a87a-426f-98ac-470bfa46fa4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:25.583653 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 210/413] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:25.591109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b0208-a87a-426f-98ac-470bfa46fa4c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.598073 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:25.602315 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5f197-66c8-4467-ad94-c72b4a107723 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.637394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:25.647022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.647673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.647954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.648229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.649375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:25.651239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:25.660794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 204/414] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:25 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:25.660794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.723431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3b0208-a87a-426f-98ac-470bfa46fa4c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.767261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.768308 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.768854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.769352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] PATH_INFO: `/v3/projects/1076d8c1402c4204a0e2862514393b33` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.770782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] RBAC: Authorizing `identity:get_project(project_id=1076d8c1402c4204a0e2862514393b33)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:25.772561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:25.774947 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 211/415] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:25 2022] GET /identity/v3/projects/1076d8c1402c4204a0e2862514393b33 => generated 344 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:25.775965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.800180 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624722dc-cbe4-4b9e-a106-7a7785458414 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.843560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.844203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.844487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.845013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.858636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:25.865275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:25.866197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:25.866980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 205/416] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:25.867627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.897082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:25.897664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:25.901750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029b9f3a-fa40-4ede-87a5-173720257f81 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:25.942365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:25.943547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:25.944113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:25.944706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff/groups/cfeab76c43b241e280dff34a241b09fe/roles/0167dcf165304e1390fd26c235128524` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:25.947239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] RBAC: Authorizing `identity:create_grant(project_id=e6225f957df243e4ac6c2de5b98355ff, group_id=cfeab76c43b241e280dff34a241b09fe, role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:25.948940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:25.970210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 212/417] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Aug 8 01:03:25 2022] PUT /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff/groups/cfeab76c43b241e280dff34a241b09fe/roles/0167dcf165304e1390fd26c235128524 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:25.971744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:25.987628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad67821-a652-495b-a464-5bb594c99e1a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:26.025202 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:26.027271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:26.027271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:26.027271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] PATH_INFO: `/v3/projects/1076d8c1402c4204a0e2862514393b33/groups/5c0c92873930495593ddb5cf4a048557/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:26.028514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=1076d8c1402c4204a0e2862514393b33, group_id=5c0c92873930495593ddb5cf4a048557, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:26.030079 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:26.049269 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 206/418] 10.222.0.39 () {58 vars in 1442 bytes} [Mon Aug 8 01:03:25 2022] PUT /identity/v3/projects/1076d8c1402c4204a0e2862514393b33/groups/5c0c92873930495593ddb5cf4a048557/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:26.194825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6217bc7-fb44-4ce4-98da-5d84e53ac489 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:26.244322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:26.245182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:26.245600 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:26.246016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:26.246887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:26.247346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:26.248940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:26.265474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 213/419] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:26.271252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:26.369865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:26.396895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efc611b-a64f-43bc-89e0-8df72099b5b2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:26.436969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:26.437881 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:26.438341 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:26.438803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:26.546361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:26.547769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:26.666137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:26.694469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 207/420] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:26.700326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:26.744866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:26.840829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8616df4f-5098-44d1-9e03-ae2f46c4cc38 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:26.875915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:26.876548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:26.876825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:26.877090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:26.878226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:26.879668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:26.885922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 214/421] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:26 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:26.887348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:27.008616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f8a19f-f670-4a38-a758-f742f75e82c6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:27.048583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab636e89-7c47-499a-ab4d-b883f5f1651e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:27.049227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636e89-7c47-499a-ab4d-b883f5f1651e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.049500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636e89-7c47-499a-ab4d-b883f5f1651e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.049769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab636e89-7c47-499a-ab4d-b883f5f1651e None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.050923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab636e89-7c47-499a-ab4d-b883f5f1651e None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:27.052423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab636e89-7c47-499a-ab4d-b883f5f1651e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:27.058154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 208/422] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:26 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:27.060243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:27.104399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b361bb-4194-4f0e-b65e-8d63bd1747ac None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.104590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b361bb-4194-4f0e-b65e-8d63bd1747ac None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.104841 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b361bb-4194-4f0e-b65e-8d63bd1747ac None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.106271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 209/423] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:27.111373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b156-b087-4023-8444-570ec89642cf None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.111677 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b156-b087-4023-8444-570ec89642cf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.111915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1789b156-b087-4023-8444-570ec89642cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.143007 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1789b156-b087-4023-8444-570ec89642cf None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:27.144476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1789b156-b087-4023-8444-570ec89642cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:27.225206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:27.226522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:27.243791 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a855d79d-3fab-4175-b4b4-232522bad4ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:27.267885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 210/424] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:27.287132 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f7e48d-ce86-4ac3-95cd-49d8fa02f92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:27.287748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e48d-ce86-4ac3-95cd-49d8fa02f92d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.288028 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e48d-ce86-4ac3-95cd-49d8fa02f92d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.288299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f7e48d-ce86-4ac3-95cd-49d8fa02f92d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.289023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7e48d-ce86-4ac3-95cd-49d8fa02f92d None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=5eed008ec382415094a2620db0a75891) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:27.289328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7e48d-ce86-4ac3-95cd-49d8fa02f92d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:27.291015 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f7e48d-ce86-4ac3-95cd-49d8fa02f92d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:27.300789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 215/425] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:27 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 611 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:27.303823 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b156-b087-4023-8444-570ec89642cf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:27.424166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d066b-564e-41aa-81e8-cda07ac8bc2a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.424510 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d066b-564e-41aa-81e8-cda07ac8bc2a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.424704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5d066b-564e-41aa-81e8-cda07ac8bc2a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.430122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 216/426] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:27 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:27.431590 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c316-3fb9-4dc2-9513-4051132ff272 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.431879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c316-3fb9-4dc2-9513-4051132ff272 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.432157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7c316-3fb9-4dc2-9513-4051132ff272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.446762 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1789b156-b087-4023-8444-570ec89642cf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:27.467661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aac7c316-3fb9-4dc2-9513-4051132ff272 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:27.468890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aac7c316-3fb9-4dc2-9513-4051132ff272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:27.488531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:27.489595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.489875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.490320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.518087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:27.523415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:27.524310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:27.525128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:27.525726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 211/427] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:27.531619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:27.590581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:27.609955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 217/428] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:27.632457 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7c316-3fb9-4dc2-9513-4051132ff272 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:27.674830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e2198-15e5-4122-83bb-9e78825816c3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:27.722242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:27.722446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:27.723657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.724127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.724593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.725517 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:27.726009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:27.727783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:27.738450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 212/429] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:27.740620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7c316-3fb9-4dc2-9513-4051132ff272 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:27.747272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:27.784448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:27.784949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.785229 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.785532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.796995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:27.801883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:27.802798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:27.803593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 218/430] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:27.810179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:27.886830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:27.892257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba1d48b-fc24-4548-92fc-be869ac2a879 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:27.926111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f176ae72-74d6-4bfd-a6ef-5d5b4d94a30d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:27.945922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:27.946568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.946848 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.947119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.972474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:27.973094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:27.973371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:27.973640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:27.975434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] RBAC: Adding query filter params (name=member) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:27.975740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:27.977730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:27.990846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 219/431] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:03:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:28.002044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.012619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.034851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:28.036323 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:28.116789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a89f85-6c42-4167-a396-9ca0fdae4812 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:28.150915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.155501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 213/432] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 01:03:28.155830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:28.156516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.156761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.157173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.164898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.235993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:28.237831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:28.246543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.275474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5692614d-0cb2-434f-be37-431be5186558 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:28.315134 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:28.315775 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.316049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.316317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] PATH_INFO: `/v3/projects/5eed008ec382415094a2620db0a75891` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.317454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] RBAC: Authorizing `identity:get_project(project_id=5eed008ec382415094a2620db0a75891)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:28.318918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:28.320884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 214/433] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/projects/5eed008ec382415094a2620db0a75891 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:28.327386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.345224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 220/434] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:28.350896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.400875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.441184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19815746-c2ce-47a2-bada-ff3c8a79375e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:28.458403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36bfcd1-4823-4ce4-bb92-64fbdeccd3cb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:28.466321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.479655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100a7a3a-d56c-4fae-89b8-e9a814097475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:28.480377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a7a3a-d56c-4fae-89b8-e9a814097475 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.480720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a7a3a-d56c-4fae-89b8-e9a814097475 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.481054 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100a7a3a-d56c-4fae-89b8-e9a814097475 None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.482354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a7a3a-d56c-4fae-89b8-e9a814097475 None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:28.483811 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100a7a3a-d56c-4fae-89b8-e9a814097475 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:28.485388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 215/435] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:28.486677 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da66d-589a-4801-a319-6355c244b6f3 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.486793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da66d-589a-4801-a319-6355c244b6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.487054 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476da66d-589a-4801-a319-6355c244b6f3 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.488484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 216/436] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:28 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:28.491204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da66d-589a-4801-a319-6355c244b6f3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.498430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28265693-5c73-4387-a085-60f3268f6cd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:28.499193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28265693-5c73-4387-a085-60f3268f6cd8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.499471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28265693-5c73-4387-a085-60f3268f6cd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.499739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28265693-5c73-4387-a085-60f3268f6cd8 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.500986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28265693-5c73-4387-a085-60f3268f6cd8 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:28.502717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28265693-5c73-4387-a085-60f3268f6cd8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:28.504277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 221/437] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:28.505191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69a34e-cc36-471c-b043-3ffbde83b369 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.505484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69a34e-cc36-471c-b043-3ffbde83b369 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.505756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b69a34e-cc36-471c-b043-3ffbde83b369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.523990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2b69a34e-cc36-471c-b043-3ffbde83b369 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:28.525192 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2b69a34e-cc36-471c-b043-3ffbde83b369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:28.596847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 222/438] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:28.597693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69a34e-cc36-471c-b043-3ffbde83b369 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.604480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476da66d-589a-4801-a319-6355c244b6f3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:28.641206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb528d25-be10-4ac7-9eec-841aec87d686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:28.641802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528d25-be10-4ac7-9eec-841aec87d686 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.642083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528d25-be10-4ac7-9eec-841aec87d686 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.642376 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb528d25-be10-4ac7-9eec-841aec87d686 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.643077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528d25-be10-4ac7-9eec-841aec87d686 None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=0167dcf165304e1390fd26c235128524, scope.project.id=5eed008ec382415094a2620db0a75891) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:28.643384 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528d25-be10-4ac7-9eec-841aec87d686 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:28.644809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb528d25-be10-4ac7-9eec-841aec87d686 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:28.647724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.651193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 217/439] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=5eed008ec382415094a2620db0a75891&role.id=0167dcf165304e1390fd26c235128524 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:28.652521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99bb64-0afd-4c6b-ace2-1067c35f7005 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.652999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99bb64-0afd-4c6b-ace2-1067c35f7005 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.653430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba99bb64-0afd-4c6b-ace2-1067c35f7005 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.655536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 218/440] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:28.656578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99bb64-0afd-4c6b-ace2-1067c35f7005 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.722912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b69a34e-cc36-471c-b043-3ffbde83b369 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:28.726708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.762084 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20ddc4a-839e-4115-bab9-cfed38f6c91d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:28.762656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ddc4a-839e-4115-bab9-cfed38f6c91d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.762934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ddc4a-839e-4115-bab9-cfed38f6c91d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.763206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20ddc4a-839e-4115-bab9-cfed38f6c91d None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.764698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ddc4a-839e-4115-bab9-cfed38f6c91d None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:28.766246 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20ddc4a-839e-4115-bab9-cfed38f6c91d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:28.768203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 223/441] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:28.769487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a869b-5115-48ae-ae40-d00f6a869fc1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.769769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a869b-5115-48ae-ae40-d00f6a869fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.770042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2a869b-5115-48ae-ae40-d00f6a869fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.782361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba99bb64-0afd-4c6b-ace2-1067c35f7005 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:28.791299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2b2a869b-5115-48ae-ae40-d00f6a869fc1 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:28.792900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2b2a869b-5115-48ae-ae40-d00f6a869fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:28.824740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:28.825389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:28.825664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:28.825988 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:28.841143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:28.846894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:28.847850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:28.848629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 219/442] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:28.849914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.883004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 224/443] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:28.883941 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a869b-5115-48ae-ae40-d00f6a869fc1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:28.916946 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:28.968982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d52e9-ee95-407a-b571-0a4d9b81ec03 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.006464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2a869b-5115-48ae-ae40-d00f6a869fc1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.008296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.008422 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.008942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.009223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.009495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.010664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=ec37613f9e804c21b03ddafcb4c445f5, scope.project.id=e6225f957df243e4ac6c2de5b98355ff) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:29.010664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.012501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.020915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 220/444] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=ec37613f9e804c21b03ddafcb4c445f5 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:29.021968 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.049204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.050216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.050635 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.051049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.052005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:29.052598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.054094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.063713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 225/445] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:29.069795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.153877 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7596271-f678-405f-8d36-82d448a74055 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.181494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.189859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b44bb7-63ae-444c-95f9-91cb1dc14341 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.198004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.198377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.201727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.201727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.211653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:29.217239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:29.218786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:29.219856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 221/446] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:29.223995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.231632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876138-7977-47ca-897e-0597d8051437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.231632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876138-7977-47ca-897e-0597d8051437 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.231866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876138-7977-47ca-897e-0597d8051437 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.232054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17876138-7977-47ca-897e-0597d8051437 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.269228 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.318777 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17876138-7977-47ca-897e-0597d8051437 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.320247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17876138-7977-47ca-897e-0597d8051437 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.347981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5042fb31-5309-4bc4-9cc8-45078e4f3e3e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.386467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.387076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.387349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.387617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.388283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:29.388660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.390289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.398658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 222/447] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:29.404228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.431764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 226/448] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 01:03:29.438196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876138-7977-47ca-897e-0597d8051437 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.448811 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.497665 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.499326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7275efbd-c7a5-42be-a1f4-57ee8ec926c3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.534230 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.534797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.535025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.535289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.536248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17876138-7977-47ca-897e-0597d8051437 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.573975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.574645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.574923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.575191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] PATH_INFO: `/v3/projects/e6225f957df243e4ac6c2de5b98355ff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.576368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] RBAC: Authorizing `identity:get_project(project_id=e6225f957df243e4ac6c2de5b98355ff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.577786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.579463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 227/449] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/projects/e6225f957df243e4ac6c2de5b98355ff => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:29.584954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.603556 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.605022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.650522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.685575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b605bda-0644-4e32-b65c-1a4b964c2f46 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.703288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 223/450] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 08 01:03:29.709210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.714125 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.720580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.721214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.721460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.721752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] PATH_INFO: `/v3/groups/cfeab76c43b241e280dff34a241b09fe` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.722888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] RBAC: Authorizing `identity:get_group(group_id=cfeab76c43b241e280dff34a241b09fe)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.724342 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.725891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 228/451] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/groups/cfeab76c43b241e280dff34a241b09fe => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:29.731741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.810929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec00ef7b-dd6c-4398-838f-72efbe69bdcd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.839191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5295556d-971f-40a1-acc2-cf42f7ca286d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:29.847463 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.848086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.848363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.848648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] PATH_INFO: `/v3/projects/1076d8c1402c4204a0e2862514393b33` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.849758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] RBAC: Authorizing `identity:get_project(project_id=1076d8c1402c4204a0e2862514393b33)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.851228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.852991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 224/452] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/projects/1076d8c1402c4204a0e2862514393b33 => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:29.858759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:29.872642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:29.873275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:29.873551 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:29.873678 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:29.873815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:29.874990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] RBAC: Adding query filter params (group.id=cfeab76c43b241e280dff34a241b09fe, role.id=0167dcf165304e1390fd26c235128524, scope.project.id=e6225f957df243e4ac6c2de5b98355ff) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:29.875373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:29.876788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:29.882519 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 229/453] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/role_assignments?group.id=cfeab76c43b241e280dff34a241b09fe&scope.project.id=e6225f957df243e4ac6c2de5b98355ff&role.id=0167dcf165304e1390fd26c235128524 => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:29.963369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae95ce12-b6cc-42d8-9c62-0249cc92e4c9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:30.000703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a1bec1-7224-4f9d-84ab-b3115be32485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:30.001348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1bec1-7224-4f9d-84ab-b3115be32485 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:30.001624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1bec1-7224-4f9d-84ab-b3115be32485 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:30.001893 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a1bec1-7224-4f9d-84ab-b3115be32485 None admin] PATH_INFO: `/v3/groups/5c0c92873930495593ddb5cf4a048557` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:30.003129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1bec1-7224-4f9d-84ab-b3115be32485 None admin] RBAC: Authorizing `identity:get_group(group_id=5c0c92873930495593ddb5cf4a048557)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:30.004598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a1bec1-7224-4f9d-84ab-b3115be32485 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:30.006213 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 225/454] 10.222.0.39 () {56 vars in 1180 bytes} [Mon Aug 8 01:03:29 2022] GET /identity/v3/groups/5c0c92873930495593ddb5cf4a048557 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:30.012345 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:30.077458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:30.115172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be62a9e8-474d-43fd-ad22-0bdfec7b7632 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:30.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69dda7d-cda3-4442-aac5-cb0fdbc34974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:30.149909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dda7d-cda3-4442-aac5-cb0fdbc34974 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:30.150224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dda7d-cda3-4442-aac5-cb0fdbc34974 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:30.150490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69dda7d-cda3-4442-aac5-cb0fdbc34974 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:30.151215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dda7d-cda3-4442-aac5-cb0fdbc34974 None admin] RBAC: Adding query filter params (group.id=5c0c92873930495593ddb5cf4a048557, role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=1076d8c1402c4204a0e2862514393b33) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:30.151515 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dda7d-cda3-4442-aac5-cb0fdbc34974 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:30.152964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69dda7d-cda3-4442-aac5-cb0fdbc34974 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:30.162801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 230/455] 10.222.0.39 () {56 vars in 1376 bytes} [Mon Aug 8 01:03:30 2022] GET /identity/v3/role_assignments?group.id=5c0c92873930495593ddb5cf4a048557&scope.project.id=1076d8c1402c4204a0e2862514393b33&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:32.748516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc82fb-77bd-4337-b3aa-9831b94c6153 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:32.749572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc82fb-77bd-4337-b3aa-9831b94c6153 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:32.750070 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dc82fb-77bd-4337-b3aa-9831b94c6153 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:32.751856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 226/456] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:32.757551 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01a50-118e-42ed-84b8-64b4164ade60 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:32.758443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01a50-118e-42ed-84b8-64b4164ade60 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:32.758942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad01a50-118e-42ed-84b8-64b4164ade60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:32.787044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5ad01a50-118e-42ed-84b8-64b4164ade60 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:32.788618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ad01a50-118e-42ed-84b8-64b4164ade60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:32.876375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 231/457] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:32.899139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb27c-2a92-485b-9058-6fccf63c450b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:32.899783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb27c-2a92-485b-9058-6fccf63c450b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:32.900250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdcb27c-2a92-485b-9058-6fccf63c450b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:32.902027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 227/458] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:32.907078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019c2e-f468-4ece-9959-3795ec773370 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:32.907364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019c2e-f468-4ece-9959-3795ec773370 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:32.907639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019c2e-f468-4ece-9959-3795ec773370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:32.915475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcb27c-2a92-485b-9058-6fccf63c450b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:32.939648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e0019c2e-f468-4ece-9959-3795ec773370 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:32.940884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e0019c2e-f468-4ece-9959-3795ec773370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:33.017763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.037307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 232/459] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:33.058266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.060769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019c2e-f468-4ece-9959-3795ec773370 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.089472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdcb27c-2a92-485b-9058-6fccf63c450b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.139617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c23749-f8f6-44b0-9c4d-d58d2d8bf069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.140543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23749-f8f6-44b0-9c4d-d58d2d8bf069 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.141000 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23749-f8f6-44b0-9c4d-d58d2d8bf069 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.141436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c23749-f8f6-44b0-9c4d-d58d2d8bf069 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.153651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c23749-f8f6-44b0-9c4d-d58d2d8bf069 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:33.155597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c23749-f8f6-44b0-9c4d-d58d2d8bf069 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-31c23749-f8f6-44b0-9c4d-d58d2d8bf069 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:33.170799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:33.171750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:33.172577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:33.172577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:33.172577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:33.172577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 228/460] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:33.173486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7c64-7849-408b-87b3-ef5e5e5c93c5 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.173968 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7c64-7849-408b-87b3-ef5e5e5c93c5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.174406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0da7c64-7849-408b-87b3-ef5e5e5c93c5 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.176021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 229/461] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:33.178947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da7c64-7849-408b-87b3-ef5e5e5c93c5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.185250 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019c2e-f468-4ece-9959-3795ec773370 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.232198 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d44dc6-1b8f-4cff-8a02-26d1b6ed2d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.233570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d44dc6-1b8f-4cff-8a02-26d1b6ed2d35 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.234455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d44dc6-1b8f-4cff-8a02-26d1b6ed2d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.234932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d44dc6-1b8f-4cff-8a02-26d1b6ed2d35 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.249382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d44dc6-1b8f-4cff-8a02-26d1b6ed2d35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:33.252105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d44dc6-1b8f-4cff-8a02-26d1b6ed2d35 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-41d44dc6-1b8f-4cff-8a02-26d1b6ed2d35 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:33.273121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:33.274030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:33.274923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:33.274923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:33.274923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:33.277608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 233/462] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:33.279239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eb10a-25f6-4520-b737-63cfd9aeb696 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.279558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eb10a-25f6-4520-b737-63cfd9aeb696 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.279875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743eb10a-25f6-4520-b737-63cfd9aeb696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.292717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0da7c64-7849-408b-87b3-ef5e5e5c93c5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.302629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-743eb10a-25f6-4520-b737-63cfd9aeb696 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:33.304412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-743eb10a-25f6-4520-b737-63cfd9aeb696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:33.331539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.332479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.332955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.333411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.334292 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:33.334916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:33.336673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:33.338721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.349005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.356044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 230/463] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:33.356761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.383224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 234/464] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:33.384873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584492df-c5d6-47f3-8a53-834579b0930c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.385201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584492df-c5d6-47f3-8a53-834579b0930c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.385448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584492df-c5d6-47f3-8a53-834579b0930c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.391006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 235/465] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:33.391006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584492df-c5d6-47f3-8a53-834579b0930c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.481408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531af732-0b20-4bf8-a610-9b46c85bd581 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.503089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584492df-c5d6-47f3-8a53-834579b0930c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.517460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588f9d20-1017-4534-8f6d-83a0d33362c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.518095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f9d20-1017-4534-8f6d-83a0d33362c0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.518390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f9d20-1017-4534-8f6d-83a0d33362c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.518654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f9d20-1017-4534-8f6d-83a0d33362c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.519300 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f9d20-1017-4534-8f6d-83a0d33362c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:33.519617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f9d20-1017-4534-8f6d-83a0d33362c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:33.520972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588f9d20-1017-4534-8f6d-83a0d33362c0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:33.536808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 231/466] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:33.536808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651e1c-ec99-44f3-9a00-de2d63040914 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.536808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651e1c-ec99-44f3-9a00-de2d63040914 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.536808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08651e1c-ec99-44f3-9a00-de2d63040914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.543017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.543985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.544359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.544802 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.545479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:33.546982 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:33.553075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-08651e1c-ec99-44f3-9a00-de2d63040914 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:33.554314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-08651e1c-ec99-44f3-9a00-de2d63040914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:33.582082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 236/467] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:33 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:33.582082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.606834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.646819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.675922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 232/468] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:33.676937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651e1c-ec99-44f3-9a00-de2d63040914 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.723569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc9bead-efe6-4295-aa33-4a601d85a2e8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.760472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.761105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.761392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.761656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.776968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:33.778474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:33.796669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:33.797595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:33.799272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:33.799272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:33.799272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:33.799272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 237/469] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:33.799597 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.805890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08651e1c-ec99-44f3-9a00-de2d63040914 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.855848 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.856465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.856739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.857371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:33.857685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:33.860679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:33.886573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 233/470] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:33 2022] POST /identity/v3/users => generated 248 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:33.888231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:33.918972 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.948265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6f08c9-365b-4a30-a224-64ddb7676e03 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:33.949398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:33.991753 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b805d-873c-43b3-8cdb-064b9d954bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:33.992503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b805d-873c-43b3-8cdb-064b9d954bdc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:33.992795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b805d-873c-43b3-8cdb-064b9d954bdc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:33.993069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b805d-873c-43b3-8cdb-064b9d954bdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.009300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b805d-873c-43b3-8cdb-064b9d954bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:34.011113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b805d-873c-43b3-8cdb-064b9d954bdc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:34.023989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33db7a-f5b0-4a76-b2c6-831b10edcfc1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2a3b805d-873c-43b3-8cdb-064b9d954bdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:34.032024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:34.033183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:34.034245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:34.034245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:34.034245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:34.034463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 238/471] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:34.039413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df939-0458-4c1d-820d-84c0dd650cc3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.039413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df939-0458-4c1d-820d-84c0dd650cc3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.039413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7df939-0458-4c1d-820d-84c0dd650cc3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.039413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 239/472] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:34.040671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df939-0458-4c1d-820d-84c0dd650cc3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:34.080972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd213497-397e-4a3f-a697-57e44b71daa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:34.081508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213497-397e-4a3f-a697-57e44b71daa2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.081785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213497-397e-4a3f-a697-57e44b71daa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.082134 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd213497-397e-4a3f-a697-57e44b71daa2 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.082803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213497-397e-4a3f-a697-57e44b71daa2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:34.083106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213497-397e-4a3f-a697-57e44b71daa2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:34.084472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd213497-397e-4a3f-a697-57e44b71daa2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:34.099116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 234/473] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:34.100217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c059b-1b06-4474-afb8-f1b2b02cdaae None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.100499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c059b-1b06-4474-afb8-f1b2b02cdaae None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.100771 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7c059b-1b06-4474-afb8-f1b2b02cdaae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.123692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5b7c059b-1b06-4474-afb8-f1b2b02cdaae None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:34.123924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5b7c059b-1b06-4474-afb8-f1b2b02cdaae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:34.178669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7df939-0458-4c1d-820d-84c0dd650cc3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:34.217133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:34.222553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 235/474] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:34.228570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c059b-1b06-4474-afb8-f1b2b02cdaae None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:34.228705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:34.228705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.228705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.228705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.229036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:34.229036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:34.229915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:34.260803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 240/475] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:34.261661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:34.267704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:34.346023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7c059b-1b06-4474-afb8-f1b2b02cdaae None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:34.368827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a7a95d-43a3-47aa-a9ef-b9774f58fab5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:34.383951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:34.384572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.384851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.385128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.385834 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:34.387403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:34.407693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:34.408803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.409277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.409748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.410686 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:34.412274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:34.418257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 236/476] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:34 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:34.420232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:34.433334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 01:03:34.433334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 01:03:34.433334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [parameters: {'id': '881a199767164889968260d3f03d2ccd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 01:03:34.433334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Aug 08 01:03:34.456598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return ref.to_dict() Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 01:03:34.457614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 01:03:34.458573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 01:03:34.459466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 01:03:34.460337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 01:03:34.461167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'id': '881a199767164889968260d3f03d2ccd', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:34.461949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 08 01:03:34.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:34.468714 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 241/477] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Aug 8 01:03:34 2022] POST /identity/v3/roles => generated 144 bytes in 207 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:34.474970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:34.581295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:34.607943 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:34.634619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58795e34-e036-4350-9331-25ea51536ee9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:34.652494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64fef4b-395d-47b1-96e3-0a1d7a668013 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:34.676805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:34.677827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.678131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.678407 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.679108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:34.681123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:34.696156 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a6d5ba-9557-46a7-af3c-eec38f862905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:34.696957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d5ba-9557-46a7-af3c-eec38f862905 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.697187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d5ba-9557-46a7-af3c-eec38f862905 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.697628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a6d5ba-9557-46a7-af3c-eec38f862905 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.711805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 237/478] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:34 2022] POST /identity/v3/users => generated 249 bytes in 292 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:34.719505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a6d5ba-9557-46a7-af3c-eec38f862905 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c2a6d5ba-9557-46a7-af3c-eec38f862905 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:34.724858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:34.725817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:34.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 242/479] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:03:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:34.733793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:34.848082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2498b3-6f3c-4aa4-8f61-9ab59417c045 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:34.888467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a269508-e91f-4307-b76e-336c8f890273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:34.889508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269508-e91f-4307-b76e-336c8f890273 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:34.889985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269508-e91f-4307-b76e-336c8f890273 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:34.890481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a269508-e91f-4307-b76e-336c8f890273 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:34.891367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a269508-e91f-4307-b76e-336c8f890273 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:34.891866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a269508-e91f-4307-b76e-336c8f890273 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:34.893474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a269508-e91f-4307-b76e-336c8f890273 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:34.903187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 238/480] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:35.847872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d7750-d041-4d9f-ac58-771e669447ee None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:35.848895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d7750-d041-4d9f-ac58-771e669447ee None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:35.849410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768d7750-d041-4d9f-ac58-771e669447ee None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:35.851232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 243/481] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:35.856959 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98abb6-d6cc-4764-adc1-cdd42b0d2bdf None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:35.857971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98abb6-d6cc-4764-adc1-cdd42b0d2bdf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:35.858479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee98abb6-d6cc-4764-adc1-cdd42b0d2bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:35.871132 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:35.887099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ee98abb6-d6cc-4764-adc1-cdd42b0d2bdf None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:35.888697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ee98abb6-d6cc-4764-adc1-cdd42b0d2bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:35.982513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 239/482] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:36.014741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d7750-d041-4d9f-ac58-771e669447ee None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:36.162803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768d7750-d041-4d9f-ac58-771e669447ee None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:36.177976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:36.212788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80896c95-a19e-4fdf-8b52-8c57726fbfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:36.213451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896c95-a19e-4fdf-8b52-8c57726fbfa8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:36.213730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896c95-a19e-4fdf-8b52-8c57726fbfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:36.214004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80896c95-a19e-4fdf-8b52-8c57726fbfa8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:36.228729 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80896c95-a19e-4fdf-8b52-8c57726fbfa8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-80896c95-a19e-4fdf-8b52-8c57726fbfa8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:36.233603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:36.234607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:36.235397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 244/483] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:36.247208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98abb6-d6cc-4764-adc1-cdd42b0d2bdf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:36.327286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ddd5-d34f-453c-9c32-8a9cfcfa36a6 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:36.327616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ddd5-d34f-453c-9c32-8a9cfcfa36a6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:36.327840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ddd5-d34f-453c-9c32-8a9cfcfa36a6 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:36.329491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 245/484] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:03:36.335726 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a02cb6-5580-4454-a377-f86edec5d347 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:36.336046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a02cb6-5580-4454-a377-f86edec5d347 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:36.336255 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a02cb6-5580-4454-a377-f86edec5d347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:36.367094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f2a02cb6-5580-4454-a377-f86edec5d347 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:36.368326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2a02cb6-5580-4454-a377-f86edec5d347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:36.419743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee98abb6-d6cc-4764-adc1-cdd42b0d2bdf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:36.466771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 246/485] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:36.477891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:36.478529 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:36.478801 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:36.479067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:36.479787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:36.480087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:36.481971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:36.484167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:36.494207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 240/486] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:36.511279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a02cb6-5580-4454-a377-f86edec5d347 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:36.512808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:36.654632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a02cb6-5580-4454-a377-f86edec5d347 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:36.663483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:36.724911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:36.726172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:36.726419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:36.726682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:36.753565 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:36.755616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:36.779760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:36.780711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:36.781566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:36.781566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:36.781566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:36.788353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 247/487] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:36.794922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:36.906299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3769a9c0-e355-470d-98eb-be4120d27450 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:36.970247 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:36.970964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:36.971160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:36.971433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:36.982336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2dea42a-f65f-4d19-bef5-da699b05c932 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:36.983403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:36.988779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:36.989663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:36.990749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 241/488] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:36.995730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.071905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.072513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.072786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.073050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.073694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:37.073988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:37.077792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:37.110086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 248/489] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:37.117348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.137671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.156211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.280198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feaeaefe-185a-4fd5-a8e7-4f236c351fbb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.330378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07a4512-63d7-4458-ac9f-a0e180d0c34c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.338789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8271360c-9451-459c-af4f-9c1712c40b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.339410 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271360c-9451-459c-af4f-9c1712c40b3c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.340108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271360c-9451-459c-af4f-9c1712c40b3c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.340404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8271360c-9451-459c-af4f-9c1712c40b3c None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.341090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271360c-9451-459c-af4f-9c1712c40b3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:37.341458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271360c-9451-459c-af4f-9c1712c40b3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:37.343249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8271360c-9451-459c-af4f-9c1712c40b3c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:37.354943 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 242/490] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:37.356207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1abd6-6bc5-4078-a75c-0da902144e1f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.356495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1abd6-6bc5-4078-a75c-0da902144e1f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.356798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d1abd6-6bc5-4078-a75c-0da902144e1f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.362132 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 243/491] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:37.363053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1abd6-6bc5-4078-a75c-0da902144e1f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.376628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72254bb-bc10-4fe3-8110-f6997a831da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.377422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72254bb-bc10-4fe3-8110-f6997a831da8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.377707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72254bb-bc10-4fe3-8110-f6997a831da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.377977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72254bb-bc10-4fe3-8110-f6997a831da8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.385294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72254bb-bc10-4fe3-8110-f6997a831da8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:37.386816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72254bb-bc10-4fe3-8110-f6997a831da8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e72254bb-bc10-4fe3-8110-f6997a831da8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:37.399639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:37.400767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:37.401867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:37.405328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 249/492] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:03:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:37.406612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664afd-d3ef-44cc-a449-82162e742dde None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.406928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664afd-d3ef-44cc-a449-82162e742dde None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.407211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664afd-d3ef-44cc-a449-82162e742dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.424655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-34664afd-d3ef-44cc-a449-82162e742dde None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:37.425856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-34664afd-d3ef-44cc-a449-82162e742dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:37.465096 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d1abd6-6bc5-4078-a75c-0da902144e1f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.481256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.492271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 250/493] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:37.493528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21aae-c8e4-4227-b598-908a02175dc0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.493812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21aae-c8e4-4227-b598-908a02175dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.494102 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e21aae-c8e4-4227-b598-908a02175dc0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.495331 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 251/494] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:37.496313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf3723-c089-400b-8328-8a1141ec4bb9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.496592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf3723-c089-400b-8328-8a1141ec4bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.496863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf3723-c089-400b-8328-8a1141ec4bb9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.502080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 252/495] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:37.502080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf3723-c089-400b-8328-8a1141ec4bb9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.508913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67327555-8a7c-44b5-8f6d-ceb218c3c0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.509604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327555-8a7c-44b5-8f6d-ceb218c3c0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.509951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327555-8a7c-44b5-8f6d-ceb218c3c0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.510322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67327555-8a7c-44b5-8f6d-ceb218c3c0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.514728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.521705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67327555-8a7c-44b5-8f6d-ceb218c3c0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:37.523257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67327555-8a7c-44b5-8f6d-ceb218c3c0c2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-67327555-8a7c-44b5-8f6d-ceb218c3c0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:37.537403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:37.538470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:37.543024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:37.543024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:37.543024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:37.543024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 244/496] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:37.543024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b454-bf5f-4b06-a0d6-c0f8d3050263 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.543024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b454-bf5f-4b06-a0d6-c0f8d3050263 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.543024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577b454-bf5f-4b06-a0d6-c0f8d3050263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.558431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c577b454-bf5f-4b06-a0d6-c0f8d3050263 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:37.559619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c577b454-bf5f-4b06-a0d6-c0f8d3050263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:37.614303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbf3723-c089-400b-8328-8a1141ec4bb9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.626179 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 245/497] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:37.627561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a356f-8764-4fe5-842e-3756665cecbc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.628003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a356f-8764-4fe5-842e-3756665cecbc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.628423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2a356f-8764-4fe5-842e-3756665cecbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.647880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.648493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.648768 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.649039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.649766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:37.650095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:37.651586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:37.654453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6d2a356f-8764-4fe5-842e-3756665cecbc None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:37.655750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6d2a356f-8764-4fe5-842e-3756665cecbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:37.690582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 253/498] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:03:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:37.691412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.723249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 246/499] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:37.724169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a356f-8764-4fe5-842e-3756665cecbc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.752773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.760173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.797788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84772452-aac3-405c-8b42-11de930ce93f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.819585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2a356f-8764-4fe5-842e-3756665cecbc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.833471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.834246 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.834532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.834803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.845312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:37.850019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:37.850944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:37.851733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 254/500] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:37.852451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.863504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.864130 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.864400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.864665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:37.865314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:37.865612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:37.867061 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:37.878798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 247/501] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:37.879728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:37.955629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0bc748-2ca6-46d5-9eac-f6e2265e481e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.973733 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.980747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:37.984395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5673a08b-e851-48b9-aff1-93b2079f3ec8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:37.991469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:37.992099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:37.992388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:37.992660 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.003001 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:38.007733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:38.008634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:38.009413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 255/502] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:38.010082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.023407 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.024018 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.024297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.024567 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.091622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.092994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.113656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1191d3c4-4600-47e0-b190-1ab767428a22 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.148333 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.149174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.149451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.149725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.159667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.161135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:38.175456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:38.176491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:38.177409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:38.177409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.177409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:38.177409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 256/503] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:38.177409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.186148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.197146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 248/504] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:38.197948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.219740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.286071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca29ba9-8cae-4e98-8384-6ff73d5a0ce6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.296553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00f6be2-fec2-43bf-a866-305e56420f62 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.319959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.320559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.320829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.321095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.321758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:38.322076 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.323473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.331246 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 257/505] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:38.332030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.332134 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.332856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.333123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.333386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.341705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.343120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:38.356260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:38.357208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:38.358155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 249/506] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:38.358728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.406597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.431903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.436143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675f3b50-815c-49df-b701-8175ad03c52b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.457561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d035b04-97ce-4d7b-8821-b2d6d9ffb1f6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.472456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.473063 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.473339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.473614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.474319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:38.474620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.476006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.484626 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 258/507] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:38.485550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.491794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.492398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.492672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.492938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.493567 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:38.493867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.495275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.507076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 250/508] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:38.507909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.583738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d30e1e4-f190-42ab-9083-c9df1283d3b3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.606997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcff127-7707-4641-beda-16a1201194a8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.617364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.620377 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.621021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.621300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.621564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.632340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.633954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.640714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.641334 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.641618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.641871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:38.647888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:38.648943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:38.649953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:38.649953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.649953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:38.652042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.653483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.653741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 259/509] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:38.654609 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:38.668312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:38.669480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:38.675118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:38.675118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.675118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:38.675118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 251/510] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:38.675387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.675471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.757180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9d3bce-9397-4676-a0a4-9c2a85ec0160 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.769765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae67cf98-70cf-4394-8320-03391bd35fd2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.789579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.790213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.790487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.790750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.791466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:38.791758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.793206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.803255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.803878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.804154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.804421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.810154 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 260/511] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:38.810922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.815870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.817542 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:38.831842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:38.832942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:38.834022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:38.834022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:38.834022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:38.834240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 252/512] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:38.834985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.853549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.882555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:38.913280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4283c24-221b-4d16-ad04-4f6e2b6afc39 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.936172 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4105eb41-f6cc-4977-8e80-3884e9519826 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:38.947007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.947609 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.947882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.948145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.948767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.950256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.971467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:38.972070 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:38.972344 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:38.972607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:38.973233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:38.973528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:38.974406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 261/513] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:38 2022] POST /identity/v3/users => generated 247 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:38.974897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:38.975349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:38.988067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 253/514] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:38.988866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.101976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808aad13-6cd2-4b43-b6fe-69515907f586 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.109561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b0fe2e-01bf-44ae-a4a7-09b44e2ba583 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.141067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.141612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.141889 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.141995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.142200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.154725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.155501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.155785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.156051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.157011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:39.157316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.159105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.173280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 262/515] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:39.174171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.216870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.218526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.278506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2115f393-d3c1-44ae-ab0d-a7d0fff795b3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.293639 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.317829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.318469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.318747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.319040 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.319658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:39.319957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.321334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.326504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 254/516] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:39.326504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.337663 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 263/517] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:39.338741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.387769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.434825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cad7eb-650f-47b8-9113-07b842b2da07 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.441548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b9ebf-7dd6-4ae8-a6c1-455da652a54b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.470844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.471776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.473671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.473671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.476855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.477494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.477773 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.478073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.479345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.481443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.485957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.487426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:39.493215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:39.494086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:39.494947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 255/518] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:39.495420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:39.504940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:39.506129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 01:03:39.507244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:39.507865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 264/519] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/users/neutron => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:39.512404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.533333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.601862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85d9a299-4dad-4384-b816-22f4987c1390 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.616484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7003b22f-7eaa-4131-8f20-7215fcc6c263 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.624240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.638828 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.639468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.639745 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.640011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.650725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.652175 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.653515 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.654276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.654634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.654922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.662824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.664287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:39.667785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:39.668659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:39.674612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:39.674612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:39.674612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:39.674612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 256/520] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:39.674612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:39.675645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:39.676472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:39.677355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 265/521] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:39.677933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.771663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.785464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306e024-ea3a-4e65-b64f-e8d872acdd34 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.788416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77fb77-8c3c-432b-ba26-f802c4a43212 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.821291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.822238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.822522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.822797 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.823527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:39.823832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.824631 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.825244 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.825342 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.825554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.825826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.826548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:39.826965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.828258 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:39.843700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 266/522] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:39.844749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.850577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 257/523] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:39.851761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:39.875861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:39.959086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fc5852-0a39-4001-abb0-4767164808d7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.959448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9709457f-819e-4eef-8fcb-c0cf0240b8bf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:39.994811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:39.995690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:39.996127 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:39.996405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:39.997052 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:39.997380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:39.998855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.000223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.000831 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.001105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.001375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.002120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:40.002424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.003834 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.016080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 267/524] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:40.016080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.047965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 258/525] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Aug 8 01:03:39 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:40.047965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.049691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.112993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.132719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a64bf3-16bf-4d34-bfbf-3a0c5b32bd8d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.159488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5947a-7b95-4bcc-bc4e-4381f8b1e302 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.169117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.169793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.170124 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.170562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.195803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.196427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.196704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.196973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.197696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4a0d809789674bdeaa6763ee4151ca86) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:40.197994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.199456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 259/526] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/role_assignments?user.id=4a0d809789674bdeaa6763ee4151ca86&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:40.206307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.267016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.269307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.291309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.332591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c287eb95-3061-4f13-ac17-742cc9478ba9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.367007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.374708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.376088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.376573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.377023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.384741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.385461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 268/527] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:40.386354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.386965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:40.399209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:40.400074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:40.400922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:40.403256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 260/528] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:40.404298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.490700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab83aa60-0a54-44d1-a9a2-dd2c7a9c576e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.510564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b338ab-ce3e-4b10-bb6c-01237085811e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.526525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.527145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.527422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.527706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.540299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.549246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.550443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.551322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.551790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.563811 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.565983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:40.581119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:40.582356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:40.583437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:40.583437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:40.583437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:40.585161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 261/529] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:40.586253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.600684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.602221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.614444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.708167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bacff77-b891-41b9-b059-21d0262cc891 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.712847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 269/530] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:40.713829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.747120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.748476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.749639 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.749918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.750646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:40.750950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.752451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.770144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 262/531] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:40.771408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.801956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.828778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e57f04-d450-429e-a82b-9985bd776c4e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.834248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:40.869278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.869928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.870247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.870516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.871315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:40.871611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.873582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:40.892691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 270/532] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:40.893923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:40.921576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e56144-77cb-4f30-9fa5-41fc2b554349 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:40.965601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:40.967049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:40.967326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:40.967595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:40.981784 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:40.984396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:41.004481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:41.006217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:41.007248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:41.007248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:41.007248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:41.007248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 263/533] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:41.007248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.027338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9fc9a7-5be4-4544-ad68-edcf21072b68 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.066551 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.067153 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.067430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.067708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.068425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=74ee9575f99d40b88236d82f14780260) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:41.068731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:41.070200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.075868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 271/534] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:40 2022] GET /identity/v3/role_assignments?user.id=74ee9575f99d40b88236d82f14780260&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:41.076761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.088589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:41.126821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:41.139669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e26987-ee1b-42b5-a26f-b9c7d3da17eb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.187593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c6abbc-3ac9-4bd1-80f3-ec5b3672e961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.188299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6abbc-3ac9-4bd1-80f3-ec5b3672e961 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.188578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6abbc-3ac9-4bd1-80f3-ec5b3672e961 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.188873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c6abbc-3ac9-4bd1-80f3-ec5b3672e961 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.197290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6abbc-3ac9-4bd1-80f3-ec5b3672e961 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:41.198814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c6abbc-3ac9-4bd1-80f3-ec5b3672e961 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-48c6abbc-3ac9-4bd1-80f3-ec5b3672e961 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:41.211794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:41.212717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:41.213580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:41.216408 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f250c1-1e69-4857-be31-6a394752b3ad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.217971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 264/535] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:41.219579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61156e5e-2c6b-4ffa-aefd-615026b0ab57 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.219864 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61156e5e-2c6b-4ffa-aefd-615026b0ab57 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.220134 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61156e5e-2c6b-4ffa-aefd-615026b0ab57 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.222365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 265/536] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:41.223217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61156e5e-2c6b-4ffa-aefd-615026b0ab57 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.256893 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772fcb63-8a5b-4b72-9c62-627a3fca236e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.257513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fcb63-8a5b-4b72-9c62-627a3fca236e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.257787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fcb63-8a5b-4b72-9c62-627a3fca236e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.259478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772fcb63-8a5b-4b72-9c62-627a3fca236e None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.259478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fcb63-8a5b-4b72-9c62-627a3fca236e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:41.259478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fcb63-8a5b-4b72-9c62-627a3fca236e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:41.260422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-772fcb63-8a5b-4b72-9c62-627a3fca236e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.273808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 272/537] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:41.275473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f1581-2f67-4aa1-822b-dd6307c26049 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.280339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f1581-2f67-4aa1-822b-dd6307c26049 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.280991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f1581-2f67-4aa1-822b-dd6307c26049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.303334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ab5f1581-2f67-4aa1-822b-dd6307c26049 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:41.305747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ab5f1581-2f67-4aa1-822b-dd6307c26049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:41.358405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61156e5e-2c6b-4ffa-aefd-615026b0ab57 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.388499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:41.402320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 273/538] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:41.403509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f1581-2f67-4aa1-822b-dd6307c26049 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.405388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.405944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.406266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.406593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.407300 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:41.407606 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:41.409204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.426495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 266/539] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:41.427427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.447266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:41.544940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f1581-2f67-4aa1-822b-dd6307c26049 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.552909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95859d-da46-42ac-8547-812f191c3105 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.589706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.590496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.590845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.591176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.592400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.593333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.593936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.594447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.598570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:41.600116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.605794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:41.610992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:41.611876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:41.612673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:41.613904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:41.614733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:41.615556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:41.617367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 267/540] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:41.618316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.619898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 274/541] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:41.620870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.691533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:41.696853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:41.728320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8141c1-a4f6-4f56-8787-d45817544ad9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.751236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7fdfdc-5869-4785-9016-1a5183a3929a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:41.764875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.766087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.766815 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.767265 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.768190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4af463e787364ed680b453d027c81f72) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:41.768766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:41.771043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.778430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 268/542] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/role_assignments?user.id=4af463e787364ed680b453d027c81f72&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:41.779549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.818480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:41.819553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:41.819936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:41.820748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:41.821887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:41.822310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:41.824484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:41.865606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 275/543] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:41.872902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:41.977503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6060d18-bb48-43bf-95a4-293429b5fe49 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.021862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.022531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.022793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.023068 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.023740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:42.024119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:42.025433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:42.028165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:42.036797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 269/544] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:42.041913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:42.064550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58090b8e-132f-40fb-a2c5-8ff7233d27d9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.112500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:42.150654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c049760-cbb2-46bf-acac-42ee1b5e5917 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.186495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.186705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cf5095-f1a2-41e4-a443-1823aa3c96d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.187113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5095-f1a2-41e4-a443-1823aa3c96d2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.187215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.187389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5095-f1a2-41e4-a443-1823aa3c96d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.187485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.187662 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.187774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cf5095-f1a2-41e4-a443-1823aa3c96d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.188401 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf5095-f1a2-41e4-a443-1823aa3c96d2 None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=a043a385f94e4aef84280c4a1533da28) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:42.188707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf5095-f1a2-41e4-a443-1823aa3c96d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:42.198635 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cf5095-f1a2-41e4-a443-1823aa3c96d2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:42.198862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:42.200271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:42.216045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:42.216987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:42.218551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:42.218551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:42.218551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:42.218551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 270/545] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:42.220030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 276/546] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:41 2022] GET /identity/v3/role_assignments?user.id=a043a385f94e4aef84280c4a1533da28&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 259 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:42.227306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:42.279776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aabab-f4f5-49be-909d-9e723c264051 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.280113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aabab-f4f5-49be-909d-9e723c264051 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.280318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233aabab-f4f5-49be-909d-9e723c264051 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.281969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 277/547] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:42.299579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ea04-e763-419b-bed9-da5e319f3b88 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.299895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ea04-e763-419b-bed9-da5e319f3b88 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.300126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9762ea04-e763-419b-bed9-da5e319f3b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.310030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:42.341881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9762ea04-e763-419b-bed9-da5e319f3b88 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:42.343546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9762ea04-e763-419b-bed9-da5e319f3b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:42.412317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5f7439-67ef-4af3-b7d9-98f359a5bbbf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.442074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 278/548] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:42.460889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ea04-e763-419b-bed9-da5e319f3b88 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:42.472980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.473694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.473976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.474269 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.474918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:42.475219 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:42.476590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:42.489962 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 271/549] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:42.495875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:42.648917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14423c99-4a86-4222-9f8e-55c07eebd747 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.660675 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:42.680141 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9762ea04-e763-419b-bed9-da5e319f3b88 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.692883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.693516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.693785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.694064 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.705623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:42.707326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:42.709293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:42.731252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:42.733253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:42.734616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 272/550] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:42.738645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:42.742465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.743108 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.743389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.743661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.754557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:42.759297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:42.761426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:42.763654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 279/551] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:42.770480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:42.876164 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02861d-1af3-4ce6-9241-5bde0cdd08ec None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.884621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cad764-02f2-45de-b57a-93031add04cc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:42.922451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.923058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.923333 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.923601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.924263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:42.924550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:42.926045 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:42.935212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 280/552] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:42.943574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:42.945856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:42.946510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:42.946789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:42.947059 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:42.947803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:42.948105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:42.949532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:42.968090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 273/553] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:42.973680 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.011493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.037701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.126391 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd0db76-0fdc-427f-8d3f-ad175d0f8607 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:43.140344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa65fcdb-d3cf-4a82-8d26-5353a69794af None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:43.194724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb24f07-6438-4cad-ab9e-4cca1efa2817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:43.195260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24f07-6438-4cad-ab9e-4cca1efa2817 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.195535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24f07-6438-4cad-ab9e-4cca1efa2817 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.195801 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb24f07-6438-4cad-ab9e-4cca1efa2817 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.210761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:43.211401 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.211677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.211946 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.234906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:43.236488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:43.261701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:43.262706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:43.263618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:43.263618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:43.263618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:43.265388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 281/554] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:43.276720 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.342111 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb24f07-6438-4cad-ab9e-4cca1efa2817 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:43.344194 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb24f07-6438-4cad-ab9e-4cca1efa2817 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:43.378534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.381956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.396976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cab23-f823-4a7a-ae54-3173a3bded0c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:43.438369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd2ab2f-4149-4f4c-973e-824a5bb9eb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:43.438976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ab2f-4149-4f4c-973e-824a5bb9eb49 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.439601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ab2f-4149-4f4c-973e-824a5bb9eb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.439866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd2ab2f-4149-4f4c-973e-824a5bb9eb49 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.440702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ab2f-4149-4f4c-973e-824a5bb9eb49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:43.440998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ab2f-4149-4f4c-973e-824a5bb9eb49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:43.442601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd2ab2f-4149-4f4c-973e-824a5bb9eb49 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:43.455836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 282/555] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:43.456989 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a7599-7e28-468d-8cbe-15f714ddbafc None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.457268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a7599-7e28-468d-8cbe-15f714ddbafc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.457539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a7599-7e28-468d-8cbe-15f714ddbafc None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.462979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 283/556] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:43.463862 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a7599-7e28-468d-8cbe-15f714ddbafc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.466148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 274/557] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:43.467509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffd679-d941-48a2-8357-0f7175140df7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.472301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffd679-d941-48a2-8357-0f7175140df7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.472703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ffd679-d941-48a2-8357-0f7175140df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.490552 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-57ffd679-d941-48a2-8357-0f7175140df7 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:43.491897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-57ffd679-d941-48a2-8357-0f7175140df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:43.560346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 275/558] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:43.561133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffd679-d941-48a2-8357-0f7175140df7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.586858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a7599-7e28-468d-8cbe-15f714ddbafc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:43.621755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.639999 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:43.640648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.640926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.641200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.649321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:43.650872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:43.663375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:43.665631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:43.667545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:43.668597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ffd679-d941-48a2-8357-0f7175140df7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:43.674121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 284/559] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:03:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:43.674121 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.683926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.705231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:43.706066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.706520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.706855 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.718098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:43.719650 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:43.735439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:43.736736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:43.737840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:43.737840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:43.737840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:43.742492 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 276/560] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:43.743318 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.788413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedb444a-7152-4933-9be3-3ddc160c91b7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:43.825261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:43.826397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.826877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.827291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.839099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:43.846275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:43.847393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:43.848386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:43.849098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f917a8e-09f6-4e29-add6-65fbe76326a1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:43.855528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 285/561] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:43.857023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.859833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.885600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:43.886461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:43.886656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:43.886932 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:43.887674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:43.888070 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:43.889592 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:43.912522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 277/562] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:03:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:43.912522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:43.942956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:43.980865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36bbdcb-aa38-465e-ba99-a992566eda21 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.017370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499f408-1fed-40d7-8d32-cae1ca064487 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.018236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.019103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.019546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.020032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.020825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:44.021291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.022933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.036964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 286/563] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:44.038136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.058265 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.058887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.059168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.059476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.060271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:44.060576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.061943 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.071195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 278/564] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:44.072017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.104225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.149008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a076fd82-68b4-4fd6-8b72-9ffce1287041 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.177888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.184102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5c058a-222c-489c-8e5c-7983769d9717 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.187611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.188247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.188522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.188793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.199612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.201099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:44.215520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:44.216553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:44.217453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:44.217453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:44.217453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:44.217453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 287/565] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:44.217453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.227080 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e3968e-27fc-4ac4-818e-40aa720e298c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.227979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3968e-27fc-4ac4-818e-40aa720e298c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.228438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3968e-27fc-4ac4-818e-40aa720e298c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.228886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e3968e-27fc-4ac4-818e-40aa720e298c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.236591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3968e-27fc-4ac4-818e-40aa720e298c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.238011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e3968e-27fc-4ac4-818e-40aa720e298c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-27e3968e-27fc-4ac4-818e-40aa720e298c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:44.251533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:44.252416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:44.253297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:44.253719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 279/566] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:44.254759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d11a3-38a8-4b49-9642-fe942eda61d2 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.255043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d11a3-38a8-4b49-9642-fe942eda61d2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.255319 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0d11a3-38a8-4b49-9642-fe942eda61d2 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.256689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 280/567] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:44.257251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d11a3-38a8-4b49-9642-fe942eda61d2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.332025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d3115f-ff7c-4fef-ac6a-bfe1674229be None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.358277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.369756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0d11a3-38a8-4b49-9642-fe942eda61d2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.369909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.370489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.370771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.371037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.382013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.383511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:44.397562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:44.398586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:44.399505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:44.399505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:44.399505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:44.399505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 288/568] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:44.399505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.415312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6de335-6b4e-4f2c-af33-0f4c80030d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.415922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de335-6b4e-4f2c-af33-0f4c80030d91 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.416201 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de335-6b4e-4f2c-af33-0f4c80030d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.416459 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6de335-6b4e-4f2c-af33-0f4c80030d91 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.417111 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6de335-6b4e-4f2c-af33-0f4c80030d91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:44.417411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6de335-6b4e-4f2c-af33-0f4c80030d91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.418838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6de335-6b4e-4f2c-af33-0f4c80030d91 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.432023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 281/569] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:44.433302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c912-6750-4291-8761-3233cbd24173 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.433589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c912-6750-4291-8761-3233cbd24173 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.433859 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e5c912-6750-4291-8761-3233cbd24173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.442730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.452074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d9e5c912-6750-4291-8761-3233cbd24173 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:44.453263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d9e5c912-6750-4291-8761-3233cbd24173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:44.524229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 282/570] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:44.525055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c912-6750-4291-8761-3233cbd24173 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.525383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52845216-0182-43d5-abb0-a5596f843940 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.562865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.563464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.563739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.564003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.565034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:44.565329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.566804 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.579272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 289/571] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:44.580046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.603487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.627514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e5c912-6750-4291-8761-3233cbd24173 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.661936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f41db5-f9ae-4666-b111-b69ebf189130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.662562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41db5-f9ae-4666-b111-b69ebf189130 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.662836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41db5-f9ae-4666-b111-b69ebf189130 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.663104 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41db5-f9ae-4666-b111-b69ebf189130 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.663736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41db5-f9ae-4666-b111-b69ebf189130 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:44.664029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41db5-f9ae-4666-b111-b69ebf189130 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.665383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f41db5-f9ae-4666-b111-b69ebf189130 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.672837 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.676630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 283/572] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:44.677881 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1c45-2280-4da2-a3d3-063518972d36 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.678212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1c45-2280-4da2-a3d3-063518972d36 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.678467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cf1c45-2280-4da2-a3d3-063518972d36 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.679624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 284/573] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:44.682826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1c45-2280-4da2-a3d3-063518972d36 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.683625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c83e96-78f1-4385-b477-2e9c3aef96fc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.717607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.718265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.718539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.718806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.725601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.727095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:44.738287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:44.739316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 290/574] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:44.740382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.784277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cf1c45-2280-4da2-a3d3-063518972d36 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.817615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.818339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.818610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.818895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.826670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.830636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:44.835427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:44.836504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 285/575] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:44.837338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:44.844528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddde3c3-c53d-416d-8abd-3f8c73de4d88 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.878471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9461e5-7d11-4395-8da6-c835e5f86123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.879050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9461e5-7d11-4395-8da6-c835e5f86123 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.879318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9461e5-7d11-4395-8da6-c835e5f86123 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.879583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9461e5-7d11-4395-8da6-c835e5f86123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.880292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9461e5-7d11-4395-8da6-c835e5f86123 None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=d6ee2855740e4797afb4843d04446870) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:44.880588 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9461e5-7d11-4395-8da6-c835e5f86123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:44.882010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9461e5-7d11-4395-8da6-c835e5f86123 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:44.887609 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 291/576] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/role_assignments?user.id=d6ee2855740e4797afb4843d04446870&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:44.888876 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ed12e-d33e-4fa2-a9e1-afb1c614752b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.889158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ed12e-d33e-4fa2-a9e1-afb1c614752b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.889426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ed12e-d33e-4fa2-a9e1-afb1c614752b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.909719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d48ed12e-d33e-4fa2-a9e1-afb1c614752b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:44.911001 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d48ed12e-d33e-4fa2-a9e1-afb1c614752b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:44.923048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:44.947037 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccacf31-384d-4140-bda2-1e071cef3802 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:44.983364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:44.984011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:44.984290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:44.984566 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:44.993274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 292/577] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:44.994564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ed12e-d33e-4fa2-a9e1-afb1c614752b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.003521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.005273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:45.018187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:45.019381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 01:03:45.020565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:45.026183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 286/578] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:45.027143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.095068 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.115342 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ed12e-d33e-4fa2-a9e1-afb1c614752b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.139379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22be45a-4552-4176-a6b8-3de55f569cd1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.153473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.154120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.154404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.154673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.155594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:45.156003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.157449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.174923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 293/579] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:45.174923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.177890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.178539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.178692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.178852 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.179085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.179761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:45.180099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.181553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.190938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 287/580] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:45.196005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.284706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d8df1-9572-45f5-8aeb-1e322c7dc42c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.298214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6686ecf-5f9b-415e-81cd-2275a981d34b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.320760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.321391 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.321670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.321941 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.323885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.333235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:45.337518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.338160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.338436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.338827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:45.339466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:45.340364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:45.347009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:45.347705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:45.347705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.347833 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 294/581] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:45.347900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.347966 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.368813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 288/582] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:45.370266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.412450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.453036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af2e4f3-aca7-4a93-a853-3447e24755d5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.477212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e68c93-2ca0-47d4-afd8-a933f54ca80e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.488421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.489090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.489366 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.489639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4a0d809789674bdeaa6763ee4151ca86/roles/425493bbc4074fcf99b58b8a87915b6a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.505423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=4a0d809789674bdeaa6763ee4151ca86, role_id=425493bbc4074fcf99b58b8a87915b6a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.507025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.512303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.513163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.513676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.513976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.534080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 295/583] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:45 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4a0d809789674bdeaa6763ee4151ca86/roles/425493bbc4074fcf99b58b8a87915b6a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:45.534080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.536940 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.538500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:45.556035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:45.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:45.557950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:45.557950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:45.557950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:45.557950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 289/584] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:45.558714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.597654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.678547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924395ad-83c7-4140-8b41-a3b68e7250cd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.679410 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e6b814-df2b-450c-914c-49d26ceab9cd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.699239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.721717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.722767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.723264 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.723753 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.724617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.725235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.725514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.725786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.726494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:45.727529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.728173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.737828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 296/585] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:45.738698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.742759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.744286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:45.759695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:45.760847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:45.761891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:45.761891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:45.761891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:45.761891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 290/586] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:45.765968 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.863928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7050c39-d5f3-4866-8b83-809f0f301eae None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.873345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.896085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106a30e5-3d6c-4510-8bde-69579fa6146a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:45.899245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.899868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.900147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.900421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.901070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:45.901370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.902806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.915946 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 297/587] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:45.916800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:45.941534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:45.942208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:45.942745 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:45.943019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:45.956822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:45.958838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:45.970439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:45.977093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:45.978097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:45.978987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:45.978987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:45.978987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:45.978987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 291/588] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:45.983910 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.031964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ed3a22-9a71-4f2c-ba38-a9c4c96803af None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.071003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.071616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.072141 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.072411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.073054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:46.073593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.076395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.094440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 298/589] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:46.095326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.112505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5850e0-615c-403a-8944-94432d9537fa None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.156615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.157747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.158097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.158367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.161913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:46.169684 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.171657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:46.187076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:46.188286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 292/590] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:45 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:46.189827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.213610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:46.225583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e94a3-0074-430b-8f67-cd646e0b52ee None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.261030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.261641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.261921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.262235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.262936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:46.263236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.264623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.276992 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 299/591] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:46.277920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.326917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab775710-4d81-486e-a7fd-331a3742cbae None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.361894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.362557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.362836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.363112 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.370365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.372048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:46.384284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:46.385415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:46.386447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:46.390237 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 293/592] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:46.391215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.399797 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb7d96d-6108-459e-b2c6-72e777782d5e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.443385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.444040 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.444323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.444594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.445320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:46.445624 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.447198 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.455468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:46.468863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 300/593] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:46.470004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.487144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:46.515061 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cdca73-4681-459e-a9bb-2c317b1a8c48 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.560180 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.560813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.561082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.561349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.571654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.573731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.582700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862c4a3b-6d71-43c5-9442-001c1b9f7543 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:46.588358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:46.589502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 294/594] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/users/cinder => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:46.590627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.633643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.634185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.634460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.634726 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.635409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:46.635705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.637137 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.658240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 301/595] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:46.658240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31adfb9e-6d68-4444-8429-cbf8eedb3e48 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.724519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:46.755048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.755963 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.756389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.756814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.759828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:46.770278 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.772001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:46.786816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:46.787995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:46.788993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:46.788993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:46.788993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:46.790714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 295/596] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:46.790816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfd88db-f18a-47d1-83a5-4d7d8a5175cd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.791694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.836680 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.837289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.837572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.838285 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.839026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:46.839329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.841847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.864584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 302/597] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:46.865702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:46.912102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06105e4a-6cf0-4888-a4cc-3b433fa37ae8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.949430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:46.950389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:46.950787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:46.951192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/74ee9575f99d40b88236d82f14780260/roles/425493bbc4074fcf99b58b8a87915b6a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:46.966587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=74ee9575f99d40b88236d82f14780260, role_id=425493bbc4074fcf99b58b8a87915b6a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:46.968048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094d070-6e54-4f94-ba30-fb0f1683879d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:46.968182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:46.983333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 296/598] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:46 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/74ee9575f99d40b88236d82f14780260/roles/425493bbc4074fcf99b58b8a87915b6a => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:46.983999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.008254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.009580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.017190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9e5af5-b2db-4dd2-9ca9-aa5fc8dca037 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.018242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e5af5-b2db-4dd2-9ca9-aa5fc8dca037 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.018672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e5af5-b2db-4dd2-9ca9-aa5fc8dca037 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.019177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9e5af5-b2db-4dd2-9ca9-aa5fc8dca037 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.020731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e5af5-b2db-4dd2-9ca9-aa5fc8dca037 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:47.021221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e5af5-b2db-4dd2-9ca9-aa5fc8dca037 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.023307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9e5af5-b2db-4dd2-9ca9-aa5fc8dca037 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.041903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 303/599] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:47.043959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74182-f9e2-40b0-a34a-e237e8a7d992 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.044405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74182-f9e2-40b0-a34a-e237e8a7d992 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.044938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee74182-f9e2-40b0-a34a-e237e8a7d992 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.051265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 304/600] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:47.052417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74182-f9e2-40b0-a34a-e237e8a7d992 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.105027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b062c8ba-8f67-4fe4-a34b-6cf3c9f4e173 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.153422 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578747b-2849-4dff-9311-c019d82ec6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.154184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578747b-2849-4dff-9311-c019d82ec6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.154600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578747b-2849-4dff-9311-c019d82ec6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.154989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578747b-2849-4dff-9311-c019d82ec6b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.166844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578747b-2849-4dff-9311-c019d82ec6b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.168479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578747b-2849-4dff-9311-c019d82ec6b2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.177732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee74182-f9e2-40b0-a34a-e237e8a7d992 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4578747b-2849-4dff-9311-c019d82ec6b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:47.185359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:47.186346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:47.187255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:47.187255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:47.187255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:47.188109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 297/601] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:47.188688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81445618-5b1a-44ec-8804-d5d520ad6535 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.189654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81445618-5b1a-44ec-8804-d5d520ad6535 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.189654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81445618-5b1a-44ec-8804-d5d520ad6535 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.211864 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-81445618-5b1a-44ec-8804-d5d520ad6535 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:47.213186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-81445618-5b1a-44ec-8804-d5d520ad6535 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:47.215585 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.217317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.217654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.217926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.226090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.227892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:47.242404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:47.243343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:47.244231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 305/602] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:47.244711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.287624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 298/603] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:47.288893 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81445618-5b1a-44ec-8804-d5d520ad6535 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.302499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.308491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.368184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef33c68-49c6-4595-aa72-cba626067752 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.396486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81445618-5b1a-44ec-8804-d5d520ad6535 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.409995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.410648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.411100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.411392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.412277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:47.412574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.414149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.430115 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 306/604] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:47.431403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.436361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.437253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.437723 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.438253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.439471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:47.440007 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.441688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.454980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 299/605] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:47.456225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.527672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.548402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a937038-8944-4dab-9d78-c1938f357cf0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.562578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.584186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d20c70-54d1-4470-9c6a-a97e77022615 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.586116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.586803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.587083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.587355 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.598313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:47.603142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:47.604053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:47.604892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 307/606] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:47.605589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.626497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.627505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.627776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.628039 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.637402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.640382 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:47.654920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:47.656927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 300/607] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:47.659110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.724465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9dfff4-e640-4148-84e9-943415b70244 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.762899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.763691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.763970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.764237 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4af463e787364ed680b453d027c81f72/roles/425493bbc4074fcf99b58b8a87915b6a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.765163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153d55fe-1a0e-4a19-a5c5-ecb65cf040e5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.781574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=4af463e787364ed680b453d027c81f72, role_id=425493bbc4074fcf99b58b8a87915b6a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.783165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.787198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.802629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 308/608] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:47 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4af463e787364ed680b453d027c81f72/roles/425493bbc4074fcf99b58b8a87915b6a => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:47.803743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.820960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b553d4-00db-4943-8ea7-f098c7a30854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.821771 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b553d4-00db-4943-8ea7-f098c7a30854 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.822346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b553d4-00db-4943-8ea7-f098c7a30854 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.822761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b553d4-00db-4943-8ea7-f098c7a30854 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.824207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b553d4-00db-4943-8ea7-f098c7a30854 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:47.824652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b553d4-00db-4943-8ea7-f098c7a30854 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.826713 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b553d4-00db-4943-8ea7-f098c7a30854 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:47.835905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:47.842273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 301/609] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:47.845643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f034d-818f-4b0e-a390-981d48316216 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.847049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f034d-818f-4b0e-a390-981d48316216 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.847932 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241f034d-818f-4b0e-a390-981d48316216 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.850612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 302/610] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:47.852332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f034d-818f-4b0e-a390-981d48316216 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:47.945649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dcf870-1337-4389-80a5-033f2017e0cc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.978731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241f034d-818f-4b0e-a390-981d48316216 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:47.988099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383d1bb2-9e4a-4682-a917-843ad4f183c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:47.988706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1bb2-9e4a-4682-a917-843ad4f183c5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:47.988981 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1bb2-9e4a-4682-a917-843ad4f183c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:47.989248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383d1bb2-9e4a-4682-a917-843ad4f183c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:47.989937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d1bb2-9e4a-4682-a917-843ad4f183c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:47.990280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d1bb2-9e4a-4682-a917-843ad4f183c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:47.991786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383d1bb2-9e4a-4682-a917-843ad4f183c5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.004231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 309/611] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:48.005544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b347-5ff4-4bc0-9192-63a17bda3670 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.005834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b347-5ff4-4bc0-9192-63a17bda3670 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.006126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c83b347-5ff4-4bc0-9192-63a17bda3670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.018487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.019214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.019489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.019755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.025260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7c83b347-5ff4-4bc0-9192-63a17bda3670 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:48.026497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c83b347-5ff4-4bc0-9192-63a17bda3670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:48.032249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:48.033686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:48.049449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:48.050486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:48.051397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:48.051397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:48.051397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:48.051397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 303/612] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:48.052106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.092574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:48.106719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 310/613] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:48.110279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b347-5ff4-4bc0-9192-63a17bda3670 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.138262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:48.180652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10bffd7-26f7-444c-be26-7996d6967564 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:48.218963 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.219627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.219904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.220294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/a043a385f94e4aef84280c4a1533da28/roles/425493bbc4074fcf99b58b8a87915b6a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.236450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=a043a385f94e4aef84280c4a1533da28, role_id=425493bbc4074fcf99b58b8a87915b6a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:48.237949 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.249522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c83b347-5ff4-4bc0-9192-63a17bda3670 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:48.257844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 304/614] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:48 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/a043a385f94e4aef84280c4a1533da28/roles/425493bbc4074fcf99b58b8a87915b6a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:48.258839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.297557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.298641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.299290 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.299699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.301129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:48.301586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:48.303420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.325201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 311/615] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:48.335154 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.379874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:48.400534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee32851-2a2a-46df-ac1c-85313732b02d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:48.443251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.444149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.444563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.444995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.459225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:48.465370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:48.467011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:48.468026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:48.471047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 305/616] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:48.476914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.520829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:48.559013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c32e7f8-4a79-4e82-8f90-29c57712d6ce None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:48.605856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.607239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.607792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.608225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.613524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed00bac4-5a11-4cbe-92a6-b51970c79ea1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:48.618728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:48.620358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:48.636808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:48.638039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:03:48.639213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:48.646223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 312/617] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:48.651042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.657895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.658803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.659295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.659758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.660624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:48.662031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:48.663625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.674236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 306/618] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:48.683096 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.697460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:48.826010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a545b-2250-4313-8c21-09805e848695 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:48.843550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0100440-41ea-4f16-b0d0-923030349817 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:48.890315 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.890955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.891234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.891505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.902413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:48.909876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:48.911372 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.912048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:48.912774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:48.916281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:48.916281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:48.916281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:48.916281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:48.916281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:48.945508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:48.946722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:48.947604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:48.947604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:48.947604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:48.954809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 307/619] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:48.955373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 313/620] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:48.956174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:48.962460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.046418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:49.079798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9e89a-466e-47d2-8847-782b032d3ab5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.116862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3613d4-a861-498f-aff9-ef1129903a91 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.129105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.130203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.130681 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.131195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.155642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.156214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.156838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.157114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.157387 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.158034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:49.158373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.158761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:49.159721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:49.173754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 308/621] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:49.179725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:49.191471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:49.192460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:49.193340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:49.193340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:49.193340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:49.195159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 314/622] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:49.202474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.299510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c0ca3-360a-4fc0-8ae2-0f8eec77cf49 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.306416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:49.323568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:49.347740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7141ba-2893-4bf0-a2e2-00adca973539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.348301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7141ba-2893-4bf0-a2e2-00adca973539 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.348576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7141ba-2893-4bf0-a2e2-00adca973539 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.348894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7141ba-2893-4bf0-a2e2-00adca973539 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.349538 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c502d8ac-4008-417b-8ee8-f75986ee8f42 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.357560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7141ba-2893-4bf0-a2e2-00adca973539 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.359370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7141ba-2893-4bf0-a2e2-00adca973539 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ee7141ba-2893-4bf0-a2e2-00adca973539 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:49.374359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:49.375302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:49.376646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 309/623] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:49.377239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12d0b0-2be1-4448-a11e-9243cb682d7d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.377239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12d0b0-2be1-4448-a11e-9243cb682d7d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.377636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa12d0b0-2be1-4448-a11e-9243cb682d7d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.384378 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 310/624] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:49.385406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12d0b0-2be1-4448-a11e-9243cb682d7d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.397315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5032eb2-8411-4010-af3b-615e065eb1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.397980 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032eb2-8411-4010-af3b-615e065eb1e9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.398305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032eb2-8411-4010-af3b-615e065eb1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.398577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5032eb2-8411-4010-af3b-615e065eb1e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.399225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5032eb2-8411-4010-af3b-615e065eb1e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:49.399527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5032eb2-8411-4010-af3b-615e065eb1e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.401835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5032eb2-8411-4010-af3b-615e065eb1e9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:49.422444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 315/625] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:49.424266 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb7082-048f-4901-a320-0778604cd7ed None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.424543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb7082-048f-4901-a320-0778604cd7ed None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.426305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdb7082-048f-4901-a320-0778604cd7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.447735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1fdb7082-048f-4901-a320-0778604cd7ed None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:49.449313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1fdb7082-048f-4901-a320-0778604cd7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:49.498424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa12d0b0-2be1-4448-a11e-9243cb682d7d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.529571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 316/626] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:49.535151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb7082-048f-4901-a320-0778604cd7ed None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.544619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.544912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.545125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.545390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.546376 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:49.546676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.548234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:49.570900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 311/627] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:49.574131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.577325 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:49.609021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:49.655223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdb7082-048f-4901-a320-0778604cd7ed None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.679591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e540c9c-c87e-4c7f-91f1-d0ddfc07b6e7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.695596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.696687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.697166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.697633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.705203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.707163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:49.717894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.718577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.718846 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.719109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:49.721078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:49.721959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:49.723305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:49.730129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:49.730591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 317/628] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:49.732702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:49.734730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:49.735640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:49.736455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:49.740824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 312/629] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:49.741686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.835981 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:49.845780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c273dee-9757-472c-b7ed-5caa9acd68fc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.847813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:49.853652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222308b3-7331-4f41-9591-82fbf432673f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:49.885088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29100d9a-46ba-4c6b-aff6-f4ce9555dbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.886179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100d9a-46ba-4c6b-aff6-f4ce9555dbc5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.886662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100d9a-46ba-4c6b-aff6-f4ce9555dbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.887131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29100d9a-46ba-4c6b-aff6-f4ce9555dbc5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.890564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:49.891182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:49.891454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:49.891718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:49.892850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:49.892850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.894276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:49.911792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 313/630] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:49.911792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:49.974162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29100d9a-46ba-4c6b-aff6-f4ce9555dbc5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:49.976093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29100d9a-46ba-4c6b-aff6-f4ce9555dbc5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.017031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df90ac2-76a8-44ea-8a08-8a77604ae3ec None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.053192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.053868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.054169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.054439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.055159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:50.055459 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.056831 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.065692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 314/631] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:50.066507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.075634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.086678 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 318/632] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:50.090751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.092524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896f357-f6f0-401e-ae28-c59bf3dba8da None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.092908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896f357-f6f0-401e-ae28-c59bf3dba8da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.093280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1896f357-f6f0-401e-ae28-c59bf3dba8da None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.098238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 319/633] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:50.098238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896f357-f6f0-401e-ae28-c59bf3dba8da None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.185073 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d427cc3-6cd9-4780-89a4-a8f25d134e4f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.208058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1896f357-f6f0-401e-ae28-c59bf3dba8da None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.222456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.223108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.223580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.223697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/d6ee2855740e4797afb4843d04446870/roles/425493bbc4074fcf99b58b8a87915b6a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.239524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=d6ee2855740e4797afb4843d04446870, role_id=425493bbc4074fcf99b58b8a87915b6a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.240964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.245618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f9a945-cbcd-4723-92d8-0e5717c8b4e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.246466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a945-cbcd-4723-92d8-0e5717c8b4e1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.246690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a945-cbcd-4723-92d8-0e5717c8b4e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.247050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f9a945-cbcd-4723-92d8-0e5717c8b4e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.256842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 315/634] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:03:50 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/d6ee2855740e4797afb4843d04446870/roles/425493bbc4074fcf99b58b8a87915b6a => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:03:50.257664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.271301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9a945-cbcd-4723-92d8-0e5717c8b4e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.272789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f9a945-cbcd-4723-92d8-0e5717c8b4e1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-08f9a945-cbcd-4723-92d8-0e5717c8b4e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:50.301886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:50.303014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:50.303915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:50.303915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:50.303915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:50.306157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 320/635] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:50.307664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d290f98-d0c4-45e9-8112-5e863201e98c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.308085 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d290f98-d0c4-45e9-8112-5e863201e98c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.308486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d290f98-d0c4-45e9-8112-5e863201e98c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.334146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2d290f98-d0c4-45e9-8112-5e863201e98c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:50.336422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2d290f98-d0c4-45e9-8112-5e863201e98c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:50.343685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.385726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c24353-f5ce-4a59-8b85-fbc3fe39658a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.403647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.436282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.436915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.437117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.437389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.442831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 321/636] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:50.444008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d290f98-d0c4-45e9-8112-5e863201e98c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.450654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.452185 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:50.467945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:50.469003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:50.469928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:50.469928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:50.469928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:50.469928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 316/637] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:50.475118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.569086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d290f98-d0c4-45e9-8112-5e863201e98c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.600874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ad5d44-e322-4853-ae32-c27ef869a777 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.604710 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.605400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.605744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.606158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.606872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:50.607173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.608561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.624390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 322/638] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:50.624390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.626068 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.641885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca66d9d-7f90-443f-8fb7-036d2597c9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.642517 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca66d9d-7f90-443f-8fb7-036d2597c9a9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.642790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca66d9d-7f90-443f-8fb7-036d2597c9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.643062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca66d9d-7f90-443f-8fb7-036d2597c9a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.643706 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca66d9d-7f90-443f-8fb7-036d2597c9a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:50.644001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca66d9d-7f90-443f-8fb7-036d2597c9a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.645356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca66d9d-7f90-443f-8fb7-036d2597c9a9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.657577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 317/639] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:50.658916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6035-7c00-455d-8a0b-e859f67d98c7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.659193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6035-7c00-455d-8a0b-e859f67d98c7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.659465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d6035-7c00-455d-8a0b-e859f67d98c7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.662138 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 318/640] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:50.662138 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6035-7c00-455d-8a0b-e859f67d98c7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.662995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.734820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149f3c86-32c4-4ad0-9eae-f345193fb04d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.767181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d6035-7c00-455d-8a0b-e859f67d98c7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.770349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.770985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.771261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.771528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.784566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:50.790886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:50.791799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:50.792622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:50.795610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 323/641] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:50.796646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.808322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8e08e6-d0d3-4552-828b-ab71452a2253 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.808967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e08e6-d0d3-4552-828b-ab71452a2253 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.809316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e08e6-d0d3-4552-828b-ab71452a2253 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.809933 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8e08e6-d0d3-4552-828b-ab71452a2253 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.818739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e08e6-d0d3-4552-828b-ab71452a2253 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.820193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8e08e6-d0d3-4552-828b-ab71452a2253 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6c8e08e6-d0d3-4552-828b-ab71452a2253 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:50.832718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:50.833829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 319/642] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:50.835030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677969-c025-44c9-844b-ab138203ec3b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.835687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677969-c025-44c9-844b-ab138203ec3b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.835687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5677969-c025-44c9-844b-ab138203ec3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.854751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d5677969-c025-44c9-844b-ab138203ec3b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:50.855942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d5677969-c025-44c9-844b-ab138203ec3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:50.895918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.905890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:50.914278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c99ec52-5c4b-4e60-bf9f-d15a0ea4cd00 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:50.932514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 320/643] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:50.933572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677969-c025-44c9-844b-ab138203ec3b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:50.963027 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:50.963938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:50.964231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:50.964483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:50.971332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:50.972779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:50.983886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:50.984783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 324/644] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:50.985800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.044240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5677969-c025-44c9-844b-ab138203ec3b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.079614 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.080286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.080563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.080833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.081544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:51.081850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.083263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.089580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209d6caa-3eef-4693-a308-f59a12e5ff10 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.091257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 321/645] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:51.092104 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.133413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.134095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.134370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.134785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.135382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:51.135688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.135997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.137585 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.160728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 325/646] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Aug 8 01:03:50 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:51.160728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.173658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.215090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5598dc-bd64-49aa-a2c2-09b33ebbb9d6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.248997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.249547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.249821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.250432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.264457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:51.267447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6bc9e3-e036-4d5c-afc8-3776860a1144 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:51.269531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:51.270560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:51.271452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:51.275621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 322/647] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:51.276210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.306862 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.307476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.307754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.308036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.308713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:51.309017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.310779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.323105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 326/648] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:51.323937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.373605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.382623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecdf86-673a-4f48-9af4-03c2c780fbc8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.400135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.420436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.421092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.421371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.421643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.432973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.434616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b4982-a528-4bb6-9806-10bf536d30d2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.434748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:51.450207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:51.451208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:51.452121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:51.452121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:51.452121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:51.452121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 323/649] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:51.452121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.477258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.478234 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.478708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.479170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.549582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.551050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.561135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3c321c-eb34-4285-94e5-821505a3de12 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.597106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.597865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.598174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.598449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.599116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:51.599444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.600896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.609436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 324/650] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:51.610147 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.620578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.629984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.662795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 327/651] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:51.663677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.722223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eba1cbf-3463-49a7-9095-6e54604d1f13 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.758177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.758785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.759056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.759315 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.760036 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4a0d809789674bdeaa6763ee4151ca86) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:51.760338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.761817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.765859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a33f5f-3277-456a-b5c2-ddfe47be44e2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.778078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 325/652] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/role_assignments?user.id=4a0d809789674bdeaa6763ee4151ca86&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:51.778078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.817238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.817801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.818155 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.818430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.819096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:51.819402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.820975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:51.835018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 328/653] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:51.836286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:51.876591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.878916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:51.924413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c724da-ef2f-44ea-8608-2abcf7ea897f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.968476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:51.969119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:51.969392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:51.969657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:51.974481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db28fbc-8a6d-4737-a33a-0c8f145164ad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:51.982929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:51.984516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:52.002569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:52.003814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:52.005095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:52.005095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:52.005095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:52.006204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 326/654] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:52.007124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.025854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.026743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.027089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.027459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.042633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.044913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:52.061712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:52.062823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:52.063752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:52.063752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:52.063752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:52.068352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 329/655] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:52.068944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.132318 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2f1fe9-8c56-4f32-9995-a37a7d84540c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.157429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.162989 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.172443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.173317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.173767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.174247 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.179841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1680683-3728-4e1f-ba7c-452f352c7808 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.182706 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.184353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:52.196374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:52.197555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 08 01:03:52.198741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:52.201113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 327/656] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/users/neutron => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:52.202091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.228893 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.229659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.230020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.230384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.231214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:52.232329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.233895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.247628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 330/657] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:52.253657 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.305917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9ba5e9-9658-4d6e-9680-93dec0be923a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.342114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.342720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.342981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.343249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.343886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:52.344182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.345532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.362145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 328/658] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:52.362145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.374812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0634af9-ce2d-46b9-9761-c7471878291d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.411019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9be7ac-5474-49a5-9cf4-a0016a11fa5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.411891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9be7ac-5474-49a5-9cf4-a0016a11fa5c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.411891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9be7ac-5474-49a5-9cf4-a0016a11fa5c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.412164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9be7ac-5474-49a5-9cf4-a0016a11fa5c None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.412481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.412921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9be7ac-5474-49a5-9cf4-a0016a11fa5c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:52.413178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9be7ac-5474-49a5-9cf4-a0016a11fa5c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.414708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9be7ac-5474-49a5-9cf4-a0016a11fa5c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.433755 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 331/659] 10.222.0.39 () {56 vars in 1139 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:52.435114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90d853-3d45-4cc1-9a69-dc84767ca291 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.435397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90d853-3d45-4cc1-9a69-dc84767ca291 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.435668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e90d853-3d45-4cc1-9a69-dc84767ca291 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.436847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 332/660] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:52.437533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90d853-3d45-4cc1-9a69-dc84767ca291 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.441057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.479711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec18fa3-5518-44c0-886f-58a56155837b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.515590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.516223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.516908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.517187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.525437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.527368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:52.542301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:52.543252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:52.544259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 329/661] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:52.544998 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.547259 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e90d853-3d45-4cc1-9a69-dc84767ca291 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.583743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5496a95c-641e-4037-a738-b01890bd845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.584378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a95c-641e-4037-a738-b01890bd845f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.584656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a95c-641e-4037-a738-b01890bd845f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.584926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5496a95c-641e-4037-a738-b01890bd845f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.591824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496a95c-641e-4037-a738-b01890bd845f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.593339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5496a95c-641e-4037-a738-b01890bd845f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5496a95c-641e-4037-a738-b01890bd845f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:52.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:52.605666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:52.606793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 333/662] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:52.607366 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d088e04-1f23-4b11-9c0f-d4f2cd4602c4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.607366 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d088e04-1f23-4b11-9c0f-d4f2cd4602c4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.607818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d088e04-1f23-4b11-9c0f-d4f2cd4602c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.625436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1d088e04-1f23-4b11-9c0f-d4f2cd4602c4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:52.626625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1d088e04-1f23-4b11-9c0f-d4f2cd4602c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:52.659653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b517d4e0-66f7-41f9-8f64-e79907bc889c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.661171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.689991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.700737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.701386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.701616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.701932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 334/663] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:52.702031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.703079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d088e04-1f23-4b11-9c0f-d4f2cd4602c4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.784951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.786693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.810069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d088e04-1f23-4b11-9c0f-d4f2cd4602c4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.845917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:52.846475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:52.846746 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:52.847017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:52.847740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:52.848039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:52.849461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:52.873937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 335/664] 10.222.0.39 () {56 vars in 1137 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:52.874839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.894170 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 330/665] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:52.894170 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:52.894170 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.930778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:52.981859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f68ffd4-adb6-4659-8228-51b2f21efd62 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:52.998156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd8de5d-087e-40c9-b826-6c894c7c8069 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.016459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.017150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.017511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.017842 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.019092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:53.019459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.021315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.032786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.033417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.033701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.033970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.038894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 336/666] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:53.039780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.045490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:53.050223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:53.051122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:53.051979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 331/667] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:53.053575 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.120628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:53.163131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5837d7-09b9-4f3f-9f8d-37ca42207ec9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.165512 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df5990d-4151-4667-b238-20d59f992415 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.176499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:53.200795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.201558 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.201902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.202017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.202326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.202741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.203085 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.203352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.212727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.214212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:53.229327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:53.230518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:53.231525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:53.231525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:53.231525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:53.235006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 332/668] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:53.235788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.276379 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.277900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.337980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0461db9d-c564-4337-a961-b6d599250d49 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.353480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:53.375895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.376714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.376992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.377265 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.377987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=74ee9575f99d40b88236d82f14780260) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:53.378321 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.379750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.386354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 333/669] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/role_assignments?user.id=74ee9575f99d40b88236d82f14780260&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:53.386644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.387103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 337/670] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:53.388025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.407327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:53.512583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cdd31f2-f5b5-4788-b381-ff0f9c89744d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.539832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e13981-01d6-4c33-b0e6-9e8e3c4f8151 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.552003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.552948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.553437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.553843 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.554705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:53.555273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.557570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.567468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 334/671] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:53.568549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.578469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.579170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.579509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.579948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.580667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:53.581136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.582652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.596289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 338/672] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:53.597169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.623233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:53.692754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:53.702487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e73e560-3d25-48fb-aa25-c02e54a8a1cd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.734439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b857105-29c6-4bfa-91e5-525e6307f870 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.745349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.746119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.746398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.747030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.759032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.760474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:53.776093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:53.777072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:53.778139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:53.778139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:53.778139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:53.778139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 335/673] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:53.778564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.783957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.784629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.784913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.785239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.800407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.801994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:53.822553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:53.824879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:53.827042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:53.827042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:53.827042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:53.827042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 339/674] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:53.827042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.884293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:53.895276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0323a80-679d-4457-9de2-3afe751cb45b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.932408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:53.933203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:53.933568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:53.933926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:53.941990 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:53.943621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:53.955224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:53.956325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:53.957615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:53.960918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8140a259-aab0-4aab-80fa-50f7914d81f0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:53.964123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 336/675] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:53.965217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:53.987118 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.000874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.001621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.002042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.002426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.003166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:54.003559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.005075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.019501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 340/676] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:54.020525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.092361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6019fb52-0021-466a-8d89-3ac481e73ef7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.139892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.140647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.141012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.141252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d743be-3bec-44fe-9f4f-e5ea7956f793 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.141455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.142218 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:54.142610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.144043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.156770 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 337/677] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:54.157766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.178099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.275727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15aa1f20-1967-40ef-981e-cb0dc4e49b54 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.301707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435032c1-dc38-4aea-99f6-3fe40129749c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.302346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435032c1-dc38-4aea-99f6-3fe40129749c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.302634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435032c1-dc38-4aea-99f6-3fe40129749c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.302972 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435032c1-dc38-4aea-99f6-3fe40129749c None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.303591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435032c1-dc38-4aea-99f6-3fe40129749c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:54.303888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435032c1-dc38-4aea-99f6-3fe40129749c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.305411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435032c1-dc38-4aea-99f6-3fe40129749c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.313082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.313713 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.314348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.314617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.319062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 341/678] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:54.320640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f17a-0231-4304-a739-863c73adc914 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.321270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f17a-0231-4304-a739-863c73adc914 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.321621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.321913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726f17a-0231-4304-a739-863c73adc914 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.323207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.323833 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 342/679] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:54.324796 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726f17a-0231-4304-a739-863c73adc914 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:54.334985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:54.335904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:54.336791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 338/680] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:54.337277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.380297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.409393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.439493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce80280-7c7e-4ec3-8a11-2b4dc84da541 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.448421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726f17a-0231-4304-a739-863c73adc914 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.472658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e3751-c15d-409f-ba9c-cf2baa86d6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.473252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e3751-c15d-409f-ba9c-cf2baa86d6bb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.473526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e3751-c15d-409f-ba9c-cf2baa86d6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.473795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e3751-c15d-409f-ba9c-cf2baa86d6bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.474538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e3751-c15d-409f-ba9c-cf2baa86d6bb None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4af463e787364ed680b453d027c81f72) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:54.474840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e3751-c15d-409f-ba9c-cf2baa86d6bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.476363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e3751-c15d-409f-ba9c-cf2baa86d6bb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.482295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 339/681] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/role_assignments?user.id=4af463e787364ed680b453d027c81f72&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:54.483472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204e1a-196f-42de-a273-af15409fbce5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.483748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204e1a-196f-42de-a273-af15409fbce5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.484012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93204e1a-196f-42de-a273-af15409fbce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.495243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.496227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.496739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.497223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.503306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-93204e1a-196f-42de-a273-af15409fbce5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:54.504533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-93204e1a-196f-42de-a273-af15409fbce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:54.506771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.508710 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:54.524402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:54.525520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:03:54.526555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:54.529400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 343/682] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/users/swift => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:54.530709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.590373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 340/683] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:54.592257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204e1a-196f-42de-a273-af15409fbce5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.667033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89511d19-1a26-4587-ae66-446da033c027 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.668926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.670729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.713603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.714242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.714488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.714808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.715524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:54.715825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.717584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.721003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93204e1a-196f-42de-a273-af15409fbce5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.731215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 344/684] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:54.732071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.763221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.763442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.763868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.764258 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.764991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:54.765439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.767774 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.788703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 341/685] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:54.789479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.852171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af428c3c-3463-4ec3-802d-d970f2b6312a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.886281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.886907 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.887203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.887474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.898150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:54.901548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70937e0d-b000-42d0-904c-a5ba87e6f0c8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:54.902748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:54.903754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:54.904593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 345/686] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:54.905295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:54.930417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.932634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:54.946696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:54.947499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:54.947870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:54.948233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:54.949056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=a043a385f94e4aef84280c4a1533da28) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:54.949458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:54.951194 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:54.966083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 342/687] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/role_assignments?user.id=a043a385f94e4aef84280c4a1533da28&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:54.966083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.072152 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea871d2a-5179-4f57-83a3-126eae06a21d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.083855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda56ac-4bf5-4230-9df8-3a82fbe8954a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.112472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970c89e-685f-4188-aa11-800779298778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.113218 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970c89e-685f-4188-aa11-800779298778 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.113566 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970c89e-685f-4188-aa11-800779298778 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.114078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0970c89e-685f-4188-aa11-800779298778 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.114884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970c89e-685f-4188-aa11-800779298778 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:55.115274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970c89e-685f-4188-aa11-800779298778 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.116859 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0970c89e-685f-4188-aa11-800779298778 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.127376 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 343/688] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:55.133251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970c89e-685f-4188-aa11-800779298778 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.163689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.164618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.165190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.165628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.191246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:55.243193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.244944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.246236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0970c89e-685f-4188-aa11-800779298778 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.270671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:55.284802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.285581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.285928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.286300 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.298963 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.299988 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:55.315887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:55.316891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:55.317755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:55.317755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:55.317755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:55.317755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 344/689] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:55.322935 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.362670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 346/690] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:55.369123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.433003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed0f766-aef3-452b-bf48-cb49968f7cd7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.434113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:55.469399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.470017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.470368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.470645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.471296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:55.471599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.473177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.478828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4d0c8f-5a10-4cc3-bc52-121feb4005df None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.489401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 345/691] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:55.491682 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.523596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:55.548091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.548730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.549005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.549275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.569868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.571390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.596800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9edef7-1ea3-43b5-b50d-50390f84d8d1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:55.603100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:55.604025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:55.605002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:55.605002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:55.605002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:55.606789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 347/692] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:55.614985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.631752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.632392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.632671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.632938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.641235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.642884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:03:55.656663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:55.657623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:03:55.658603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:55.662251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 346/693] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:03:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:55.663620 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.694544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:55.778150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1eba21-4c4e-4fb8-8706-8d168ba32ee7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.847599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb9d0d9-6087-478a-b869-d6f35e96fcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.848381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d0d9-6087-478a-b869-d6f35e96fcb2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.848658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d0d9-6087-478a-b869-d6f35e96fcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.849165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb9d0d9-6087-478a-b869-d6f35e96fcb2 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.850328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d0d9-6087-478a-b869-d6f35e96fcb2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:55.850886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d0d9-6087-478a-b869-d6f35e96fcb2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.852340 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb9d0d9-6087-478a-b869-d6f35e96fcb2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.852826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86f464-378b-45e8-b0e4-08dc13f9d0e6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:55.875133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 347/694] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:03:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:55.876423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3363d6-1525-4eaa-ab1f-590847aaa3e6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.876740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3363d6-1525-4eaa-ab1f-590847aaa3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.877023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3363d6-1525-4eaa-ab1f-590847aaa3e6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.882126 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 348/695] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:55.883005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3363d6-1525-4eaa-ab1f-590847aaa3e6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:55.899740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a3e185-92bd-4aa1-bb18-416fc15fb7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:55.900375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3e185-92bd-4aa1-bb18-416fc15fb7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.900702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3e185-92bd-4aa1-bb18-416fc15fb7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.900975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a3e185-92bd-4aa1-bb18-416fc15fb7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.901619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3e185-92bd-4aa1-bb18-416fc15fb7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:55.901964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3e185-92bd-4aa1-bb18-416fc15fb7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:55.904009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a3e185-92bd-4aa1-bb18-416fc15fb7a6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:55.916458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 348/696] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:55.917669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7843-837b-47b8-839e-b42e70388ac5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:55.917948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7843-837b-47b8-839e-b42e70388ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:55.918245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9d7843-837b-47b8-839e-b42e70388ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:55.940731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5a9d7843-837b-47b8-839e-b42e70388ac5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:55.942373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5a9d7843-837b-47b8-839e-b42e70388ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:55.977226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:55.986363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:56.014209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3363d6-1525-4eaa-ab1f-590847aaa3e6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.039441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 349/697] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:56.040476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7843-837b-47b8-839e-b42e70388ac5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.050564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.051371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.051737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.052145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.121417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.123238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.158248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9d7843-837b-47b8-839e-b42e70388ac5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.196422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.197080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.197352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.197616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.204345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:56.206287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.207751 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:56.220882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:56.222062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:56.223051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 350/698] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:56.223643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.237775 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 349/699] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:03:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 08 01:03:56.238827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.257833 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:56.336484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc39d1-bcd8-45dd-af38-4f2fc0bb006c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.363625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0bf39c-fe36-4b4c-9d2a-d85ad3d76fa7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.371365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.372131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.372343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.372611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.384122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.385570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:56.400270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:56.402495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:56.404661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:56.404661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:56.404661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:56.405053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.405053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.405350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 351/700] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:56.405497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.405497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.405782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.405934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:56.410087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.410291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.424236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 350/701] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:56.425085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.471393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:56.486762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:56.511497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce33927-2131-49ec-ba83-20dc4a6b0478 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.539385 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c225175-c262-45c5-bf18-bba2eb228473 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.547369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.548004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.548280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.548541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.559711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.561175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:03:56.576527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:56.578788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:03:56.580899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:03:56.580899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:03:56.580899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:56.581288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.581467 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 352/702] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:56.581617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.581617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.581617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.582024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.582208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:56.582208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.590075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.605596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 351/703] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:56.607279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.681032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efb8209-fd96-4957-aa0f-85dbabf80efb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.707932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:56.714649 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce920bac-21af-4a89-bf1f-65c1f44ccf0d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.716710 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.717308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:56.717443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.717606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.717839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.718626 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=d6ee2855740e4797afb4843d04446870) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:56.718927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.720352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.726466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 353/704] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/role_assignments?user.id=d6ee2855740e4797afb4843d04446870&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:56.727218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.761871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644bb2cb-86ba-4286-b051-9071722c5087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.763134 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bb2cb-86ba-4286-b051-9071722c5087 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.763461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bb2cb-86ba-4286-b051-9071722c5087 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.763798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644bb2cb-86ba-4286-b051-9071722c5087 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.764527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bb2cb-86ba-4286-b051-9071722c5087 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:56.764896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bb2cb-86ba-4286-b051-9071722c5087 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.766497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-644bb2cb-86ba-4286-b051-9071722c5087 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.780263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 352/705] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:56.781725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188423-3972-46d8-a68d-fcd8ce37859d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.782121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188423-3972-46d8-a68d-fcd8ce37859d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.782465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b188423-3972-46d8-a68d-fcd8ce37859d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.788035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 353/706] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:56.788913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b188423-3972-46d8-a68d-fcd8ce37859d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:56.853707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd74b9b-74c5-4067-9a8f-7d77f2c38e54 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.900660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b188423-3972-46d8-a68d-fcd8ce37859d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:56.901652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9f9cd8-5321-48a0-b655-f34465bda347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.902897 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9cd8-5321-48a0-b655-f34465bda347 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.903399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9cd8-5321-48a0-b655-f34465bda347 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.904970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9f9cd8-5321-48a0-b655-f34465bda347 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.905882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f9cd8-5321-48a0-b655-f34465bda347 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.907633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9f9cd8-5321-48a0-b655-f34465bda347 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.940780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 354/707] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:03:56 2022] POST /identity/v3/users => generated 254 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:03:56.942574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b7f3-f9ca-4dff-97b1-96b7b29767c0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.943052 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b7f3-f9ca-4dff-97b1-96b7b29767c0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.943560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e44b7f3-f9ca-4dff-97b1-96b7b29767c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.944121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:56.944915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:56.945290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:56.945631 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:56.955883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:56.957521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:56.965767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3e44b7f3-f9ca-4dff-97b1-96b7b29767c0 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:56.967419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3e44b7f3-f9ca-4dff-97b1-96b7b29767c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:03:56.973074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:56.974107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:56.974997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 354/708] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:56.981483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:57.008593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:57.026948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:57.061824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 355/709] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:57.085516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44b7f3-f9ca-4dff-97b1-96b7b29767c0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:57.138137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733ce4b2-2e12-40e6-83ee-67add826adc6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:57.181594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:57.182245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.182533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.182799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.183496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:57.183816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:57.185453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:57.202676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 355/710] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:03:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:57.208206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:57.214466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e44b7f3-f9ca-4dff-97b1-96b7b29767c0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:57.255757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:57.256417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.256679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.256950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.258040 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:57.259814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:57.275563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:57.276644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:03:57.277491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:57.279590 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 356/711] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:03:57 2022] GET /identity/v3/services/network => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:57.290111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:57.323365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:57.353884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:57.368273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4d6f77-1687-4c2c-9016-c575f77b4fa9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:57.425386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d3fe23-2953-46e6-81f6-f613504c8558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:57.426317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fe23-2953-46e6-81f6-f613504c8558 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.426734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fe23-2953-46e6-81f6-f613504c8558 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.427143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d3fe23-2953-46e6-81f6-f613504c8558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.428059 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3fe23-2953-46e6-81f6-f613504c8558 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4a0d809789674bdeaa6763ee4151ca86) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:57.428520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3fe23-2953-46e6-81f6-f613504c8558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:57.430165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d3fe23-2953-46e6-81f6-f613504c8558 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:57.436840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 356/712] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:03:57 2022] GET /identity/v3/role_assignments?user.id=4a0d809789674bdeaa6763ee4151ca86&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:57.468033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d8ba7-52a2-48a5-a441-b6f4a01842c3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:57.482988 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde214-9584-4928-bfa8-c1b17dbdfda0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.483637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde214-9584-4928-bfa8-c1b17dbdfda0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.484050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befde214-9584-4928-bfa8-c1b17dbdfda0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.485930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 357/713] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:57.491806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7c7e-de00-41c3-b7db-72296d504884 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.492347 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7c7e-de00-41c3-b7db-72296d504884 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.492759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb7c7e-de00-41c3-b7db-72296d504884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.508756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:57.510793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.518528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.519113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.519996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] RBAC: Adding query filter params (name=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:57.520442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:57.522041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:57.529836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 357/714] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:03:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:57.534242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bdcb7c7e-de00-41c3-b7db-72296d504884 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:57.535944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:57.539984 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bdcb7c7e-de00-41c3-b7db-72296d504884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:57.661327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 358/715] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 08 01:03:57.687254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb7c7e-de00-41c3-b7db-72296d504884 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:57.692557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cd27e-04ba-4d1e-8368-e3ba7bf56764 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:57.701058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:57.732446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:57.733611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.733987 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.734444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.735235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] RBAC: Adding query filter params (type=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:57.735634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:57.740589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:57.745894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 358/716] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:03:57 2022] GET /identity/v3/services?type=network => generated 124 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:03:57.802767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:57.835528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb7c7e-de00-41c3-b7db-72296d504884 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:57.895779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:57.896448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:57.896717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:57.896977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:57.897586 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:57.898989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:57.913449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:57.914589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:57.915438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 359/717] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Aug 8 01:03:57 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:03:57.923088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:58.059507 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db5f919-d63e-49d1-922f-e11651342e6b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:58.103733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d91a950-4e46-447b-b063-aabfe2fec41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:58.104350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a950-4e46-447b-b063-aabfe2fec41d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:58.104629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a950-4e46-447b-b063-aabfe2fec41d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:58.104902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d91a950-4e46-447b-b063-aabfe2fec41d None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:58.105554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91a950-4e46-447b-b063-aabfe2fec41d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:58.105911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91a950-4e46-447b-b063-aabfe2fec41d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:58.107335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d91a950-4e46-447b-b063-aabfe2fec41d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:58.114570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 359/718] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Aug 8 01:03:57 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:58.121886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:58.280353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895762db-f882-4c8e-9b91-e98c5a42572f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:58.314451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b946c1ac-09e2-4816-a1f5-0fee790cedb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:58.314977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c1ac-09e2-4816-a1f5-0fee790cedb8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:58.315248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c1ac-09e2-4816-a1f5-0fee790cedb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:58.315514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b946c1ac-09e2-4816-a1f5-0fee790cedb8 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:58.316139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c1ac-09e2-4816-a1f5-0fee790cedb8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:03:58.316430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c1ac-09e2-4816-a1f5-0fee790cedb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:03:58.317798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b946c1ac-09e2-4816-a1f5-0fee790cedb8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:03:58.323680 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 360/719] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Aug 8 01:03:58 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:03:59.524640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef06068-e75b-43a5-9b04-66ff1fd7335a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.525182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef06068-e75b-43a5-9b04-66ff1fd7335a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.525182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef06068-e75b-43a5-9b04-66ff1fd7335a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.526834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 360/720] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:59.544027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b421-610f-4768-a7f3-d00d44988d9f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.544477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b421-610f-4768-a7f3-d00d44988d9f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.544683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a8b421-610f-4768-a7f3-d00d44988d9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.553800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:59.567100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d1a8b421-610f-4768-a7f3-d00d44988d9f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:59.568594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d1a8b421-610f-4768-a7f3-d00d44988d9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:59.588891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740576db-24ad-436e-82fd-c4b119619669 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.589200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740576db-24ad-436e-82fd-c4b119619669 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.589748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740576db-24ad-436e-82fd-c4b119619669 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.591140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 361/721] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:59.596190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766d73f-0e97-4633-86b8-8b8f10a1ca00 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.596783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766d73f-0e97-4633-86b8-8b8f10a1ca00 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.596783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8766d73f-0e97-4633-86b8-8b8f10a1ca00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.631428 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8766d73f-0e97-4633-86b8-8b8f10a1ca00 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:59.632997 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8766d73f-0e97-4633-86b8-8b8f10a1ca00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:59.674800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:59.681630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 361/722] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:59.718076 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 362/723] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:03:59.723954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b421-610f-4768-a7f3-d00d44988d9f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:59.744351 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766d73f-0e97-4633-86b8-8b8f10a1ca00 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:59.873756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8766d73f-0e97-4633-86b8-8b8f10a1ca00 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:59.883446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a8b421-610f-4768-a7f3-d00d44988d9f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:03:59.917309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc3110-657e-491c-b539-4de5488d61b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:59.917951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc3110-657e-491c-b539-4de5488d61b6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.918413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc3110-657e-491c-b539-4de5488d61b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.918602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:03:59.918795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc3110-657e-491c-b539-4de5488d61b6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.921274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:03:59.922320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.922809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.923287 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.930661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc3110-657e-491c-b539-4de5488d61b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:59.935485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-21cc3110-657e-491c-b539-4de5488d61b6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:59.936532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:59.937528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:03:59.939178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 363/724] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:03:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:59.939908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f12b4-62f5-4efd-befc-4ea0d5f2076c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.939908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f12b4-62f5-4efd-befc-4ea0d5f2076c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.940278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351f12b4-62f5-4efd-befc-4ea0d5f2076c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.941556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 364/725] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:03:59.945193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:03:59.946176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:03:59.947125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 362/726] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:03:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:03:59.952400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc496-1453-45e3-bad8-727334dea0e8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:03:59.952400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc496-1453-45e3-bad8-727334dea0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:03:59.953171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:03:59.953743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923bc496-1453-45e3-bad8-727334dea0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:03:59.972691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-923bc496-1453-45e3-bad8-727334dea0e8 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:03:59.973875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-923bc496-1453-45e3-bad8-727334dea0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:03:59.992931 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.046506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 365/727] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:04:00.047452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc496-1453-45e3-bad8-727334dea0e8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.079072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b950222c-e200-4dbc-bc59-77f7985ab971 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.119385 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.120304 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.120754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.121278 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.122531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:00.123049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.124672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.134370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 363/728] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:03:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:00.135519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.157512 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923bc496-1453-45e3-bad8-727334dea0e8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.198660 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.199741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.199943 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.200898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.201710 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.202912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:00.203430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.205784 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.222089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 366/729] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:00.222089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.243879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.258761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae7db7-b1c0-4611-bd4f-b8172e2db5aa None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.293767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.294421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.294695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.294950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.310345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:00.315825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:00.316759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:00.317579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 364/730] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:00.318277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.334439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44dca9-4cc7-4b08-b8ef-1238ae4f8de7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.369258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2234c8f-5fcc-4449-850a-3d2f13060999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.369884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234c8f-5fcc-4449-850a-3d2f13060999 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.370394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234c8f-5fcc-4449-850a-3d2f13060999 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.370517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2234c8f-5fcc-4449-850a-3d2f13060999 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.380832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2234c8f-5fcc-4449-850a-3d2f13060999 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.382284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2234c8f-5fcc-4449-850a-3d2f13060999 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f2234c8f-5fcc-4449-850a-3d2f13060999 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:00.397730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:00.398722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:00.399596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:00.399596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:00.399596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:00.399596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 367/731] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:00.400353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44088e-1998-4bb6-b068-7e6c9a3d3a6d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.400632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44088e-1998-4bb6-b068-7e6c9a3d3a6d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.400899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e44088e-1998-4bb6-b068-7e6c9a3d3a6d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.402534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 368/732] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:00.403330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44088e-1998-4bb6-b068-7e6c9a3d3a6d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.432430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b15164c-fb07-4ad1-8667-8ce06e878247 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.449956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.472101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.472736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.473013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.473279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.476288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.484608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.486074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:00.500101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:00.501092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:00.501964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:00.501964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:00.501964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:00.505964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 365/733] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:00.506817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.517093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e44088e-1998-4bb6-b068-7e6c9a3d3a6d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.554043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63ad3b-7da5-4ce7-8522-32b11408732f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.555111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ad3b-7da5-4ce7-8522-32b11408732f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.555385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ad3b-7da5-4ce7-8522-32b11408732f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.555898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63ad3b-7da5-4ce7-8522-32b11408732f None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.556566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63ad3b-7da5-4ce7-8522-32b11408732f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:00.557102 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63ad3b-7da5-4ce7-8522-32b11408732f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.558920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63ad3b-7da5-4ce7-8522-32b11408732f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.569514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 369/734] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:00.571437 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513918-816c-4ef1-983e-21a3bf7e5c31 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.572089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513918-816c-4ef1-983e-21a3bf7e5c31 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.572738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37513918-816c-4ef1-983e-21a3bf7e5c31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.591186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-37513918-816c-4ef1-983e-21a3bf7e5c31 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:00.592376 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-37513918-816c-4ef1-983e-21a3bf7e5c31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:00.611023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330bb7b3-4322-4fac-a7a5-9cd5c82a5358 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.647600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.648127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.648401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.648657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.649280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:00.649581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.650971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.663025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 366/735] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:00.666099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.674207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 370/736] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:04:00.675207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513918-816c-4ef1-983e-21a3bf7e5c31 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.697250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.737654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.777262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dede98-121c-44c1-aa01-b5df43122c17 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.779818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37513918-816c-4ef1-983e-21a3bf7e5c31 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.815772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.816385 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.816658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.816924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.817174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.817599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:00.817903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.818010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.818165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.818434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.819314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.828679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.830195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:00.831051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 367/737] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:00.831850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:00.849039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:00.850236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:00.851316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:00.851316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:00.851316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:00.851316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 371/738] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:00.851316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:00.952940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890bb69f-6331-49d1-9aec-00f08edd21da None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:00.967208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:00.990734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1417db-4d31-469e-ab02-3c7f58db2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:00.991350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1417db-4d31-469e-ab02-3c7f58db2382 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:00.991629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1417db-4d31-469e-ab02-3c7f58db2382 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:00.991898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1417db-4d31-469e-ab02-3c7f58db2382 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:00.992555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1417db-4d31-469e-ab02-3c7f58db2382 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:00.993944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1417db-4d31-469e-ab02-3c7f58db2382 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.012894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 372/739] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:00 2022] POST /identity/v3/services => generated 240 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:01.014228 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37baf08-d68c-4714-a277-a3b6ecc5b91d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.014463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37baf08-d68c-4714-a277-a3b6ecc5b91d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.014756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37baf08-d68c-4714-a277-a3b6ecc5b91d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.018176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 373/740] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:01.018176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37baf08-d68c-4714-a277-a3b6ecc5b91d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.043451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:01.063115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5e44ce-c5b2-4716-9244-9b6c42b88380 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.114829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.115487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.115764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.116117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.124377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.125847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:01.138095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:01.139174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:01.140144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:01.144163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 368/741] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:04:00 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:01.145474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.156911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37baf08-d68c-4714-a277-a3b6ecc5b91d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.194789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd161fe6-8f89-4d38-b26b-f960e4e997e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.195427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd161fe6-8f89-4d38-b26b-f960e4e997e2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.195702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd161fe6-8f89-4d38-b26b-f960e4e997e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.195970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd161fe6-8f89-4d38-b26b-f960e4e997e2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.205416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd161fe6-8f89-4d38-b26b-f960e4e997e2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.206625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd161fe6-8f89-4d38-b26b-f960e4e997e2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bd161fe6-8f89-4d38-b26b-f960e4e997e2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:01.218323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:01.219309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:01.220239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 374/742] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:01 2022] GET /identity/v3/users/swift => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:01.220814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d876d-5436-4b67-b442-06ff706899ea None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.220814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d876d-5436-4b67-b442-06ff706899ea None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.221429 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d876d-5436-4b67-b442-06ff706899ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.241007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ca1d876d-5436-4b67-b442-06ff706899ea None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:01.242764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ca1d876d-5436-4b67-b442-06ff706899ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:01.256694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a26057-c8c3-463a-8e2f-be25fa800930 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.270582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:01.292809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.293515 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.293790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.294084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.294752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:01.295028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.296391 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.308064 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 369/743] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:01.308916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.311497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:01.323207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 375/744] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:01 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 08 01:04:01.324252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d876d-5436-4b67-b442-06ff706899ea None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.429970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d876d-5436-4b67-b442-06ff706899ea None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.432551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f25558f-b6dc-4482-b6e5-2d2f06c11654 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.467493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.467825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.468029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.468301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.468399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.468575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.468671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.468873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.469301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:01.469597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:01.469693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.469899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.471059 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.471330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.490494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 370/745] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Aug 8 01:04:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:01.495194 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.495277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 376/746] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Aug 8 01:04:01 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:01.495277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.518949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:01.552450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:01.594965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b2ee3d-ab2d-4f5a-aa62-a97515408fe8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.604633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb5050c-3ff3-470f-a602-8e35cf525369 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.628662 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.629214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.629488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.629757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.636737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.638392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.644247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.645401 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.645856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.646330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.647151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.648679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:01.650150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:01.651168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:01.652320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:01.656155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 371/747] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:04:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:01.656736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.668582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 377/748] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:01 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:01.669632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:01.776623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:01.813204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb2334-33ad-4af1-9948-e40acb28c059 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.821225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7666fec-4b1f-4352-8aeb-af4ddac4d583 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:01.852963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.853576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.853850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.854147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.854587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:01.871001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:01.871683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:01.871934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:01.872204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:01.944304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.945782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:01.954347 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:01.955991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.027079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.057643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 378/749] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:02.058551 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.066881 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 372/750] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:01 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:02.068127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.090788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.178845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491cb72f-b3f6-4949-81be-2696aa21a6d4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.180017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc704f3-16ea-4a06-aa99-713f9355acdd None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.216683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.217118 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.217331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.217589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.217747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.217849 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.217994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.218296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.219033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:02.219336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.221009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.228673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.230239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.240127 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 379/751] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:02.241034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:02.249810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:02.250787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:02.251672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:02.251672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:02.251672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:02.251672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 373/752] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:02.252302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.282087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.326524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.351982 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e6309b-0616-4061-b473-55e98515a1b6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.359785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ec6897-d0cd-4528-8ec4-c90896342aad None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.387330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.388278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.388612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.389035 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.394568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.395196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.395469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.395732 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.400546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.402005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.407013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.408476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:02.420209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:02.422317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:02.424474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:02.424474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:02.424474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:02.424474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 380/753] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:02.424474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:02.430075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:02.432137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:02.434621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:02.434621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:02.434621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:02.434621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 374/754] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:02.435234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.530080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.549974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d9b400-6439-4578-80f2-599972462e26 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.580927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39472905-0377-47f9-af0c-27958263e3e3 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.594123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.594746 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.595023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.595297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.595944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:02.596242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.597638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.609937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.613970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 381/755] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:02.615774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.625425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.626274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.627138 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.627572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.628758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:02.629896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.631739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.650525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 375/756] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:02.651562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.730261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d377a55b-9c55-4335-8014-3df21ad0dc27 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.766322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.767080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.767456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.768039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.768572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:02.768970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.770520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.786726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9b14f-fb55-4784-8db8-6cee784d01f0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.786928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 382/757] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:02.786928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.794539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.837426 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.838584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.839464 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.839982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.849299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.851769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:02.867747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:02.868727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:02.869589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:02.876845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 376/758] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:02.876845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:02.908750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a8edf9-8d22-4981-95e6-10f6d104360c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:02.945322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:02.945828 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:02.946004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:02.946311 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:02.946584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:02.954895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:02.956390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:02.970336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:02.972021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:02.973356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:02.977721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 383/759] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:02.978730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:03.032640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fff4068-f976-41af-9a14-d9c8a21d9190 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.060223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:03.082704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.083348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.083626 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.083896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.091004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.092397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.101950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1da56e0-a6d5-4cfa-b762-3239add60802 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:03.103772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:03.104670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:03.105541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 377/760] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:03.106072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:03.144169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c93b40-188c-4ddd-9d98-125f338eaadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.144780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c93b40-188c-4ddd-9d98-125f338eaadc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.145054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c93b40-188c-4ddd-9d98-125f338eaadc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.145327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c93b40-188c-4ddd-9d98-125f338eaadc None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.146023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c93b40-188c-4ddd-9d98-125f338eaadc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:03.146354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c93b40-188c-4ddd-9d98-125f338eaadc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.147888 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c93b40-188c-4ddd-9d98-125f338eaadc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.161787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 384/761] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:03.162919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a15b0-f127-4a4f-8dd2-583fb75c1fbd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.163201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a15b0-f127-4a4f-8dd2-583fb75c1fbd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.163476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6a15b0-f127-4a4f-8dd2-583fb75c1fbd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.164832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 385/762] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:03 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:03.169462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a15b0-f127-4a4f-8dd2-583fb75c1fbd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:03.240794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30877f2-b30a-4933-af4f-63d1fc676b2e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.244258 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:03.279338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6a15b0-f127-4a4f-8dd2-583fb75c1fbd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.284559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.285175 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.285450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.285719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.286452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:03.286755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.288640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.309728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 378/763] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:03.309728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:03.311476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:03.323387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac96b14-385b-43f6-8807-67d83f4f43f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.324183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac96b14-385b-43f6-8807-67d83f4f43f9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.325304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac96b14-385b-43f6-8807-67d83f4f43f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.325589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac96b14-385b-43f6-8807-67d83f4f43f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.326347 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac96b14-385b-43f6-8807-67d83f4f43f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:03.326651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac96b14-385b-43f6-8807-67d83f4f43f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.328120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac96b14-385b-43f6-8807-67d83f4f43f9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.342423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 386/764] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:03.343615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7bc1-4c5c-4d71-aea9-6528015b55ac None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.343976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7bc1-4c5c-4d71-aea9-6528015b55ac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.344252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dd7bc1-4c5c-4d71-aea9-6528015b55ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.364038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-67dd7bc1-4c5c-4d71-aea9-6528015b55ac None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:03.366599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-67dd7bc1-4c5c-4d71-aea9-6528015b55ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:03.445220 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc91d9-7480-49ad-bf7c-61dc098a46a4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.454086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 387/765] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:03.454086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd7bc1-4c5c-4d71-aea9-6528015b55ac None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:03.505826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.506528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.506838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.507078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.507805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=d6ee2855740e4797afb4843d04446870) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:03.508110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.509527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.515884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 379/766] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:03 2022] GET /identity/v3/role_assignments?user.id=d6ee2855740e4797afb4843d04446870&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:03.516757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:03.558880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:03.609567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dd7bc1-4c5c-4d71-aea9-6528015b55ac None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.635922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:03.655697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9fdb6e-0458-475c-b1c8-f3b3fb9f1779 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.668626 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.669625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.670111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.671346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.672165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=091efb05bd0b47fd87d3641bf7354284) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:03.672480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.674739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.683793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 388/767] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:03 2022] GET /identity/v3/role_assignments?user.id=091efb05bd0b47fd87d3641bf7354284&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 259 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:03.685951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:03.715276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53c805b-32c5-4ce7-89bd-6c0b6159184b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.716954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c805b-32c5-4ce7-89bd-6c0b6159184b None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.717489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c805b-32c5-4ce7-89bd-6c0b6159184b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.717964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53c805b-32c5-4ce7-89bd-6c0b6159184b None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4a0d809789674bdeaa6763ee4151ca86/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.720528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c805b-32c5-4ce7-89bd-6c0b6159184b None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=4a0d809789674bdeaa6763ee4151ca86, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.722329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53c805b-32c5-4ce7-89bd-6c0b6159184b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.739874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 380/768] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:04:03 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4a0d809789674bdeaa6763ee4151ca86/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:04:03.828970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6cd921-5cbc-45db-859d-f4cb30e5b8c3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:03.879098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de3ba-2a1f-4b24-b1c1-044ae9ba991d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.879281 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de3ba-2a1f-4b24-b1c1-044ae9ba991d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.879546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01de3ba-2a1f-4b24-b1c1-044ae9ba991d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.881140 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 381/769] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:03.883550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:03.884523 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.884997 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.885465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.886322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:03.886881 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827f29-70ab-4e29-a9be-e27a862555e4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:03.887162 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827f29-70ab-4e29-a9be-e27a862555e4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:03.887429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a827f29-70ab-4e29-a9be-e27a862555e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:03.888831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:03.910479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:03.911561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:04:03.912414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:03.913902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 389/770] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:03 2022] GET /identity/v3/services/network => generated 88 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:03.918303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9a827f29-70ab-4e29-a9be-e27a862555e4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:03.919652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9a827f29-70ab-4e29-a9be-e27a862555e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:03.920950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:04.000554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:04.031769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 382/771] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:03 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:04.089450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a827f29-70ab-4e29-a9be-e27a862555e4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:04.098882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b0104b-bd5f-4fc6-b8ca-32675cb88c94 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:04.140680 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:04.151606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:04.152501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:04.152996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:04.153372 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:04.154401 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] RBAC: Adding query filter params (name=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:04.155218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:04.156717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:04.162485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 390/772] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:03 2022] GET /identity/v3/services?name=network => generated 124 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:04.168292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:04.280417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bc00e-1b79-4ebf-93d6-ab4b7b09e03c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:04.290173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:04.297288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a827f29-70ab-4e29-a9be-e27a862555e4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:04.317694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:04.318406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:04.318786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:04.319064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:04.319936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] RBAC: Adding query filter params (type=network) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:04.320244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:04.321750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:04.327811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 391/773] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:04 2022] GET /identity/v3/services?type=network => generated 350 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:04.333328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:04.333554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:04.334077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:04.334375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:04.334637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:04.335218 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:04.336574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:04.345599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:04.347911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:04.349861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 383/774] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Aug 8 01:04:04 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:04.358172 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:04.437215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0660e6-db84-4e99-89ef-f58cf6bed085 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:04.473055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:04.473729 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:04.474012 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:04.474334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:04.475146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] RBAC: Adding query filter params (interface=public, service_id=92aa9e5244ce4858adcb766cd0b71722, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:04.475459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:04.476847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:04.485528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 392/775] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:04:04 2022] GET /identity/v3/endpoints?service_id=92aa9e5244ce4858adcb766cd0b71722&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:04.491010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:04.530508 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:04.563155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:04.600925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d101c9d-f2bc-4128-b70d-d65dab2fdba0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:04.624217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c8040a-f7e6-4422-bf47-ed227794a64c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:04.638131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:04.638131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:04.638780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:04.638780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:04.639504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:04.646072 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:04.647039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 393/776] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:04 2022] GET /identity/v3/services => generated 772 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:04.695987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:04.697234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:04.697664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:04.698123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:04.698927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:04.699435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:04.701131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:04.707109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 384/777] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Aug 8 01:04:04 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:04.714122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:04.856830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:04.860020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347aebdc-89cf-4a33-a64f-492af3cf514c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:04.897037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:04.897659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:04.897931 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:04.898229 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:04.898865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:04.899169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:04.900561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:04.907020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 394/778] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Aug 8 01:04:04 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:04.912076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:05.022294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0443e36c-143c-4793-b85b-4584aca13f71 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:05.059654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ac8c43-f78b-45d2-b8d5-8b27992a1874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:05.060630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8c43-f78b-45d2-b8d5-8b27992a1874 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:05.061105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8c43-f78b-45d2-b8d5-8b27992a1874 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:05.061588 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ac8c43-f78b-45d2-b8d5-8b27992a1874 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:05.062533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac8c43-f78b-45d2-b8d5-8b27992a1874 None admin] RBAC: Adding query filter params (interface=public, service_id=e54b2ca2b0224210890117e7a0f12340, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:05.063065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac8c43-f78b-45d2-b8d5-8b27992a1874 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:05.064961 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ac8c43-f78b-45d2-b8d5-8b27992a1874 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:05.077709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 385/779] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:04:04 2022] GET /identity/v3/endpoints?service_id=e54b2ca2b0224210890117e7a0f12340&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:05.082868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:05.228043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201dec9-8168-4794-a73c-9b5c3e8dca4a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:05.262260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0715f1-a549-4dea-abd2-9ac91dc50c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:05.263068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0715f1-a549-4dea-abd2-9ac91dc50c78 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:05.263343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0715f1-a549-4dea-abd2-9ac91dc50c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:05.263610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0715f1-a549-4dea-abd2-9ac91dc50c78 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:05.264215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0715f1-a549-4dea-abd2-9ac91dc50c78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:05.265592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0715f1-a549-4dea-abd2-9ac91dc50c78 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:05.271252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 395/780] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:05 2022] GET /identity/v3/services => generated 772 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:06.057305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540c8c8-8b18-477b-abeb-117d8ca7e60b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.057862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540c8c8-8b18-477b-abeb-117d8ca7e60b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.057862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f540c8c8-8b18-477b-abeb-117d8ca7e60b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.059575 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 386/781] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:06.065432 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343055-d151-42e5-b86e-135ec0169a6c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.065866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343055-d151-42e5-b86e-135ec0169a6c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.066041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2343055-d151-42e5-b86e-135ec0169a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.091363 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d2343055-d151-42e5-b86e-135ec0169a6c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:06.092561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d2343055-d151-42e5-b86e-135ec0169a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:06.128371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:06.197823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 396/782] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:06.226822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540c8c8-8b18-477b-abeb-117d8ca7e60b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.231882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c987cc0-2264-4a3d-a0bc-f0dfdc0a5eb8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.232170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c987cc0-2264-4a3d-a0bc-f0dfdc0a5eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.232438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c987cc0-2264-4a3d-a0bc-f0dfdc0a5eb8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.234245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 397/783] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:06.239737 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98279c-856c-4bdd-99e6-bd19946fb914 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.240021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98279c-856c-4bdd-99e6-bd19946fb914 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.240292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98279c-856c-4bdd-99e6-bd19946fb914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.249243 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:06.267153 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-de98279c-856c-4bdd-99e6-bd19946fb914 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:06.268368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-de98279c-856c-4bdd-99e6-bd19946fb914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:06.355562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 398/784] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:06.356828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df200-ae74-426b-9234-d8e3b869a4a4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.357151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df200-ae74-426b-9234-d8e3b869a4a4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.357423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62df200-ae74-426b-9234-d8e3b869a4a4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.359016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 399/785] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:06.364341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f704-fad2-4bb5-8b5b-768f4f2e9aeb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.364620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f704-fad2-4bb5-8b5b-768f4f2e9aeb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.364890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b178f704-fad2-4bb5-8b5b-768f4f2e9aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.382689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b178f704-fad2-4bb5-8b5b-768f4f2e9aeb None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:06.384017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b178f704-fad2-4bb5-8b5b-768f4f2e9aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:06.408735 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f540c8c8-8b18-477b-abeb-117d8ca7e60b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:06.445213 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:06.445956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.446267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.446538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.454483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 400/786] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:06 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:06.458997 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178f704-fad2-4bb5-8b5b-768f4f2e9aeb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.462316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:06.467873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:06.468780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:06.469601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 387/787] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:06.476756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.497110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:06.561870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:06.587614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b178f704-fad2-4bb5-8b5b-768f4f2e9aeb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:06.593251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dfdb9d-5b02-496f-8253-db661dff64a6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:06.622721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:06.623271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.623542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.623809 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.627935 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:06.628652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.629130 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.629499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.630539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:06.630944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:06.632423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:06.635332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:06.640103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:06.641221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 401/788] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:06.642819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.647487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 388/789] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:06.649009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.729528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:06.752257 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c17d49-66a8-4d7b-8e85-8d0ebc33d4e7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:06.772317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405d0e61-c576-4054-b53c-3b6ef691be4b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:06.787065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:06.787806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.788144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.788477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.799204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:06.803969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:06.804133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:06.805795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:06.807339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:06.814074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 402/790] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:06.814074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.815816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:06.816786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.817181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.817612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.818507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:06.818879 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:06.820311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:06.835828 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 389/791] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:06.837026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.914583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadd860-e763-4fe6-ab2f-13bc308c81d8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:06.946445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ecc7aed-8d60-461d-bccd-b88578118c00 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:06.948601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:06.949274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.949549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.949816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.956646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:06.960329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:06.961785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:06.977343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:06.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:06.981691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:06.981691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:06.981691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:06.981691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 403/792] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:06.981691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:06.988406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:06.988949 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:06.989349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:06.989685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:06.990452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:06.990817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:06.992254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.006408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 390/793] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:07.007416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.070240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.085018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b2a3a2-dbf9-464a-a114-1ea3d0a9f92c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.119459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.120344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.121048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.121597 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.131303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104bc390-748c-4157-bd76-cf0c66d1bb0d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.133155 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.134820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:07.149445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:07.150616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:07.151589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:07.151589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:07.151589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:07.157601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 404/794] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:07.158675 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.168187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.168750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.169029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.169322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.170098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:07.170386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.171752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.189590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 391/795] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:07.189590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.211103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.272062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1ea68a-bd3c-48e1-8308-285f76f4b5e9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.297731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d625d491-6b08-466f-869b-bb39551cf79e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.313184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.314224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.314449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.314711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.317175 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.325934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.327434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.338701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434f3ee5-7c7d-4522-9bab-560fc0c01829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.339315 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3ee5-7c7d-4522-9bab-560fc0c01829 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.339652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3ee5-7c7d-4522-9bab-560fc0c01829 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.339953 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434f3ee5-7c7d-4522-9bab-560fc0c01829 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.340596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3ee5-7c7d-4522-9bab-560fc0c01829 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:07.340907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3ee5-7c7d-4522-9bab-560fc0c01829 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.342312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434f3ee5-7c7d-4522-9bab-560fc0c01829 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:07.343448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:07.344340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:07.345270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:07.345270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:07.345270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:07.349401 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 405/796] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:07.349994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.354463 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 392/797] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:07.355800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e3f6b-500b-4ba6-aa72-823e77a1118e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.356083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e3f6b-500b-4ba6-aa72-823e77a1118e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.356355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e3f6b-500b-4ba6-aa72-823e77a1118e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.357653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 393/798] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:07.360133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e3f6b-500b-4ba6-aa72-823e77a1118e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.457529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.465158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75be9251-a9a6-4e7a-8c0e-b5044a026036 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.471793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e3f6b-500b-4ba6-aa72-823e77a1118e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.503478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdc1306-79f0-4d3a-aed5-d5d1cecc1475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.504105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1306-79f0-4d3a-aed5-d5d1cecc1475 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.504378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1306-79f0-4d3a-aed5-d5d1cecc1475 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.504642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdc1306-79f0-4d3a-aed5-d5d1cecc1475 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.506839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.507457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.507734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.508047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.508697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:07.508999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.510468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.512655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc1306-79f0-4d3a-aed5-d5d1cecc1475 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.514076 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdc1306-79f0-4d3a-aed5-d5d1cecc1475 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.528109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 394/799] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:07.528109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bbdc1306-79f0-4d3a-aed5-d5d1cecc1475 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:07.528350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:07.529252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:07.531071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 406/800] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/users/swift => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:07.532283 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549e0b-8406-4836-a3d0-636293558e2b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.532564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549e0b-8406-4836-a3d0-636293558e2b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.532836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3549e0b-8406-4836-a3d0-636293558e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.552721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c3549e0b-8406-4836-a3d0-636293558e2b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:07.554074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c3549e0b-8406-4836-a3d0-636293558e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:07.569299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.637388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 407/801] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:07.638269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549e0b-8406-4836-a3d0-636293558e2b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.650217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b76593-c230-4e8f-97d8-911bc154dd2a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.685296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.686023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.686405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.686747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.694630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.696098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:07.707409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:07.708590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 395/802] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:07.709540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.723633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.741299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3549e0b-8406-4836-a3d0-636293558e2b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.774562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805b470-ba7a-4847-b2ce-6a4bee35e075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.775190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b470-ba7a-4847-b2ce-6a4bee35e075 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.775465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b470-ba7a-4847-b2ce-6a4bee35e075 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.775731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805b470-ba7a-4847-b2ce-6a4bee35e075 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.782852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805b470-ba7a-4847-b2ce-6a4bee35e075 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.784302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805b470-ba7a-4847-b2ce-6a4bee35e075 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5805b470-ba7a-4847-b2ce-6a4bee35e075 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:07.795581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:07.796727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:07.797983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:07.801430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 408/803] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:07.802557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.802681 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b2e26-9dd8-4980-8601-07df36d08fe7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.802938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b2e26-9dd8-4980-8601-07df36d08fe7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.803214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86b2e26-9dd8-4980-8601-07df36d08fe7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.804445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 409/804] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:07 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:07.806087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b2e26-9dd8-4980-8601-07df36d08fe7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.809028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dd18e-2ae0-498e-a05f-90a0d53ae7c4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.844324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.844930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.845202 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.845468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.846652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:07.846952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.848748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.872753 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 396/805] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:07.872753 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.907140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86b2e26-9dd8-4980-8601-07df36d08fe7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:07.942975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:07.943622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:07.943904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:07.944161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] PATH_INFO: `/v3/services/network` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:07.944739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:07.946126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:07.954889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:07.956090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:07.957208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 410/806] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/services/network => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:07.958011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:07.971499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:07.977393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072161a5-9bd7-449b-9319-2d4a8310772d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.011433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036bf85e-dab5-4703-9ae7-a6bd278caf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.012045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf85e-dab5-4703-9ae7-a6bd278caf7e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.012324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf85e-dab5-4703-9ae7-a6bd278caf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.012598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036bf85e-dab5-4703-9ae7-a6bd278caf7e None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.013324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf85e-dab5-4703-9ae7-a6bd278caf7e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:08.013634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf85e-dab5-4703-9ae7-a6bd278caf7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.015096 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036bf85e-dab5-4703-9ae7-a6bd278caf7e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.032573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 397/807] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:08.033833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d68ee9-a8c6-4cce-9dea-f149fe4e3d84 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.034147 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d68ee9-a8c6-4cce-9dea-f149fe4e3d84 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.034419 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d68ee9-a8c6-4cce-9dea-f149fe4e3d84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.052093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-38d68ee9-a8c6-4cce-9dea-f149fe4e3d84 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:08.053294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-38d68ee9-a8c6-4cce-9dea-f149fe4e3d84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:08.059505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1153c0-ed62-4403-8e9c-6b1809d22ac2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.060655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.094765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.095358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.095638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.095914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.096640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:08.096947 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.098425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.119943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 411/808] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:04:07 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:08.119943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.127242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 398/809] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:08 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:08.128092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d68ee9-a8c6-4cce-9dea-f149fe4e3d84 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.200373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.243157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ceea8a-2fc9-42d4-80cf-256d7c4715f7 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.244576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d68ee9-a8c6-4cce-9dea-f149fe4e3d84 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.281967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.283098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.283206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.283822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.283951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.284054 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] RBAC: Adding query filter params (name=network) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:08.284272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.284521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.284616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.284802 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.286635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.293018 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 399/810] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/services?name=network => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:08.293967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.295683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.297126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.303868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:08.311640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:08.312694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:08.313944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:08.313944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:08.313944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:08.313944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 412/811] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:08.313944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.401369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bdaacf-d5a4-40ff-b6df-235b40a7cbc7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.412738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3aa05f-0cd1-4165-b06d-3a77e38b3cf9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.429656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.435753 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.436382 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.436657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.436923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.446621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.447217 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.447488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.447757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.447853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.449277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:08.463425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:08.464613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:08.465530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:08.465530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:08.465530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:08.465530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 400/812] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:08.465530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.521127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.522238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.523872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.563142 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972feff-dcf1-4314-953c-ff1b6acbc014 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.598372 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.599005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.599284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.599555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.600139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.601516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:08.610197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:08.611322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:08.612352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 401/813] 10.222.0.39 () {56 vars in 1129 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:08.613168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.630565 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 413/814] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:08.631409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.651040 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.718684 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a10b6-d01a-4ade-a7b1-9a224ad97e22 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.731222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a6b4c3-cff0-4d97-9f3a-969db356f5ea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.742249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.754396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.755008 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.755289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.755561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.756222 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] RBAC: Adding query filter params (type=network) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:08.756522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.757893 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.762711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 402/815] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/services?type=network => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:08.763548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.765415 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.766274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.766552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.766814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.767452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:08.767743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.769106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.780669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 414/816] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:08.781389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.862641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:08.864458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e665d2-b57e-43cf-9cf1-3fd13133e619 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.883895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b916b8-7789-4ea9-b38d-026e32312524 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:08.898525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.899135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.899413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.899681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.900326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:08.900623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.902090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.913298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 403/817] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:08.914102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.916401 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:08.917013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:08.917293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:08.917656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:08.918630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:08.918933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:08.920312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:08.928416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 415/818] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:08.928416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:08.965352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.017030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e02a83-044d-49bb-92a4-acb9dd134fea None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.025033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05173908-2251-4a78-bb26-e606d85a35ca None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.049228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.049770 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.050044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.050361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.058815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.059301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.059575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.059840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.059946 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.060496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.061289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.061839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:09.077296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:09.078861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:09.080377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:09.080377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:09.080377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:09.080377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 404/819] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:09.081336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.083886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.086791 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 416/820] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:08 2022] POST /identity/v3/endpoints => generated 337 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:09.087846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.201584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.206132 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b0bdbe-6ea3-4b9b-84a1-bb0a84b91da1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.215857 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c5cea-6024-4103-9551-bd7972a7f16e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.247480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.248115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.248392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.248659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.255516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.256947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.259423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.260065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.260340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.260609 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.268442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:09.269358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:09.270250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:09.271332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:09.271831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.271913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 405/821] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:09.271913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:09.287719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:09.288662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:09.289543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 417/822] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:09.290023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.347175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.383299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e97288d-f52b-4abd-abf9-88e0e962133c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.393067 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efdba9f-71da-4530-b5a9-1195e94f4435 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.416360 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.416959 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.417231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.417496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.418503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:09.418806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.420166 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.424874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 406/823] 10.222.0.39 () {56 vars in 1124 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:09.425475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.431078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.431693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.431967 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.432237 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.432880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:09.433202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.435243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.447442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 418/824] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:09.448219 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.449618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.523348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f30b53b-b708-43a9-8cac-972389b8a870 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.548535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019abb37-99dc-416e-8ec4-706ead52b1de None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.556321 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.556938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.557216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.557493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.558233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:09.558523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.559928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.563840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.572408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 407/825] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:09.573221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.584910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.585520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.585789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.586069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.586786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:09.587082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.588518 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.600551 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 419/826] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:09.601269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.659958 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.678701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f022c676-4227-44d1-b75b-ceb5cc5d510e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.700920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa1d8a3-c8a5-4cba-8e8e-53a1a6e4c33d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.712637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.713245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.713518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.713786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.714611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.716426 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.734709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.735374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.735654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.735927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.738330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 408/827] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:09 2022] POST /identity/v3/endpoints => generated 346 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:09.739123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.743871 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.745369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:09.763474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:09.764485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:09.765380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 420/828] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:09.767126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.809830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.870323 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83b0b3c-e1fd-4cf8-a1d3-db3ffb41d467 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.888648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b2aa62-77be-475c-9e76-b0376364a870 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:09.911841 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.912510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.912784 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.913052 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/d6ee2855740e4797afb4843d04446870/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.914986 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=d6ee2855740e4797afb4843d04446870, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.916573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.918898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:09.930842 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:09.931760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:09.932032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:09.932306 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/091efb05bd0b47fd87d3641bf7354284/roles/425493bbc4074fcf99b58b8a87915b6a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:09.935670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 409/829] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:04:09 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/d6ee2855740e4797afb4843d04446870/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:04:09.936524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:09.949562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=091efb05bd0b47fd87d3641bf7354284, role_id=425493bbc4074fcf99b58b8a87915b6a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:09.951091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:09.971987 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 421/830] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:04:09 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/091efb05bd0b47fd87d3641bf7354284/roles/425493bbc4074fcf99b58b8a87915b6a => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:04:10.080624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5881a0-7285-4fc8-ada2-93c73ae74aec None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:10.123162 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7db3d86-495a-4af1-9576-ad8cf73f9126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:10.124428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3d86-495a-4af1-9576-ad8cf73f9126 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:10.124428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3d86-495a-4af1-9576-ad8cf73f9126 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:10.124739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7db3d86-495a-4af1-9576-ad8cf73f9126 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:10.125453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db3d86-495a-4af1-9576-ad8cf73f9126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:10.125758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db3d86-495a-4af1-9576-ad8cf73f9126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:10.127243 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7db3d86-495a-4af1-9576-ad8cf73f9126 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:10.143160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 410/831] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:10.149479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:10.245343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:10.262789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68395d63-93e7-4de7-84e3-ce6053519111 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:10.298665 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d2a4c-998d-4470-a67b-809de970b67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:10.299698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2a4c-998d-4470-a67b-809de970b67b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:10.300176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2a4c-998d-4470-a67b-809de970b67b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:10.300650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d2a4c-998d-4470-a67b-809de970b67b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:10.301584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2a4c-998d-4470-a67b-809de970b67b None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4a0d809789674bdeaa6763ee4151ca86) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:10.302103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2a4c-998d-4470-a67b-809de970b67b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:10.303734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d2a4c-998d-4470-a67b-809de970b67b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:10.310623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 422/832] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:10 2022] GET /identity/v3/role_assignments?user.id=4a0d809789674bdeaa6763ee4151ca86&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:11.789946 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607b3-9289-4c15-b180-1aaf8f108d1b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:11.790504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607b3-9289-4c15-b180-1aaf8f108d1b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:11.790504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c607b3-9289-4c15-b180-1aaf8f108d1b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:11.792113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 411/833] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:11.797308 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00945f83-7ef4-4dcb-a2bd-2f06991d8cd6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:11.797708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00945f83-7ef4-4dcb-a2bd-2f06991d8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:11.797891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00945f83-7ef4-4dcb-a2bd-2f06991d8cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:11.816193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-00945f83-7ef4-4dcb-a2bd-2f06991d8cd6 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:11.817390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-00945f83-7ef4-4dcb-a2bd-2f06991d8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:11.885270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 423/834] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:11.907346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c607b3-9289-4c15-b180-1aaf8f108d1b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:11.965690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.013597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c607b3-9289-4c15-b180-1aaf8f108d1b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.015797 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fceb0-acca-4094-bb3d-af9f33c5f8e5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.016076 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fceb0-acca-4094-bb3d-af9f33c5f8e5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.016346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922fceb0-acca-4094-bb3d-af9f33c5f8e5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.017950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 424/835] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:12.022628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261edbb-dadf-4128-a46e-5c0f81c2221a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.022907 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261edbb-dadf-4128-a46e-5c0f81c2221a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.023179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261edbb-dadf-4128-a46e-5c0f81c2221a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.041581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-5261edbb-dadf-4128-a46e-5c0f81c2221a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:12.042749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5261edbb-dadf-4128-a46e-5c0f81c2221a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:12.053964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.054708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.054984 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.055254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.055843 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:12.057380 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:12.067623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:12.068615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:12.069446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 412/836] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:12.074826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.118606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 425/837] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:12.138012 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261edbb-dadf-4128-a46e-5c0f81c2221a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.148419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.186748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e5ee1a-5921-46d2-9e56-2fe37b1741de None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.211953 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.232570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f833c6-cedc-449b-bf11-37077f0e10c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.233587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f833c6-cedc-449b-bf11-37077f0e10c3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.234084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f833c6-cedc-449b-bf11-37077f0e10c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.234585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f833c6-cedc-449b-bf11-37077f0e10c3 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.235403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f833c6-cedc-449b-bf11-37077f0e10c3 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:12.235901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f833c6-cedc-449b-bf11-37077f0e10c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:12.237462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f833c6-cedc-449b-bf11-37077f0e10c3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:12.242687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 413/838] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:12.244118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b6ff1-7079-4151-ba7c-bc75c18211bd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.244625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b6ff1-7079-4151-ba7c-bc75c18211bd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.245090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b6ff1-7079-4151-ba7c-bc75c18211bd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.250805 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261edbb-dadf-4128-a46e-5c0f81c2221a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.250945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 414/839] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:12.251345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b6ff1-7079-4151-ba7c-bc75c18211bd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.286165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47cd469b-b8b3-4964-a408-8e2d2c9f3b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.286844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd469b-b8b3-4964-a408-8e2d2c9f3b23 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.287125 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd469b-b8b3-4964-a408-8e2d2c9f3b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.287447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cd469b-b8b3-4964-a408-8e2d2c9f3b23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.299987 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47cd469b-b8b3-4964-a408-8e2d2c9f3b23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-47cd469b-b8b3-4964-a408-8e2d2c9f3b23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:12.304759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:12.305864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:12.307043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 426/840] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:12.307742 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ed42a-f7d1-43ea-a3e7-f73ea2dbd9ff None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.307742 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ed42a-f7d1-43ea-a3e7-f73ea2dbd9ff None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.307742 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246ed42a-f7d1-43ea-a3e7-f73ea2dbd9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.327144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-246ed42a-f7d1-43ea-a3e7-f73ea2dbd9ff None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:12.328331 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-246ed42a-f7d1-43ea-a3e7-f73ea2dbd9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:12.363260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b6ff1-7079-4151-ba7c-bc75c18211bd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.393537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.398163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce758e4-150c-42e5-bcd9-4b484c13174e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.398778 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce758e4-150c-42e5-bcd9-4b484c13174e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.399050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce758e4-150c-42e5-bcd9-4b484c13174e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.399203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 427/841] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:12.399317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce758e4-150c-42e5-bcd9-4b484c13174e None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.400002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce758e4-150c-42e5-bcd9-4b484c13174e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:12.400402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce758e4-150c-42e5-bcd9-4b484c13174e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:12.401842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce758e4-150c-42e5-bcd9-4b484c13174e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:12.406938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 415/842] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:12.407063 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ed42a-f7d1-43ea-a3e7-f73ea2dbd9ff None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.408066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72210-2261-4cbd-93e3-d9c2d960d665 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.408349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72210-2261-4cbd-93e3-d9c2d960d665 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.408620 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e72210-2261-4cbd-93e3-d9c2d960d665 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.414121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 416/843] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:12.415643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a88fbf-c07b-4655-8226-e4fdc22f6e46 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.415897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a88fbf-c07b-4655-8226-e4fdc22f6e46 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.416176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a88fbf-c07b-4655-8226-e4fdc22f6e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.435529 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-06a88fbf-c07b-4655-8226-e4fdc22f6e46 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:12.436719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-06a88fbf-c07b-4655-8226-e4fdc22f6e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:12.484486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.515858 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 417/844] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:12 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:12.517006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a88fbf-c07b-4655-8226-e4fdc22f6e46 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.534909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246ed42a-f7d1-43ea-a3e7-f73ea2dbd9ff None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.576703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.577247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.577516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.577836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.578485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:12.578777 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:12.580207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:12.589715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 428/845] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:12.590440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.639640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a88fbf-c07b-4655-8226-e4fdc22f6e46 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.654923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.674706 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.675351 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.675635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.675911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.686414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:12.691456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:12.692452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:12.693307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 418/846] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:12.694007 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.704825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41fbf453-541c-4adf-b52a-11b843a2ec06 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.731893 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.744531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.745304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.745749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.746184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.746818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:12.748288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:12.757184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:12.758420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:12.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:12.760786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 429/847] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:12.761494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.806207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20288c1-668e-4505-b3b9-51cf92af9c0b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.844086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.844634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.844908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.845177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.855952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:12.857395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:12.871037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace21d50-94a7-419f-98f6-bca435730adb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:12.873029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:12.874144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:12.875181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:12.875181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:12.875181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:12.878770 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 419/848] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:12.879610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.903172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:12.915736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:12.916349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:12.916630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:12.916900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:12.917768 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:12.918093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:12.920190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:12.928475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 430/849] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:12.929747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:12.986807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.000865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f69468c-fcb6-4557-ac70-df94ca3c5057 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.032747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2917b98-2e15-4d0e-8913-0d932c452cc3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.035103 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.035725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.036001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.036268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.036895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:13.037197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.038606 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.043600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 420/850] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:13.044227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.073629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.074621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.075088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.075360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.076013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:13.076326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.077687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.094438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 431/851] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:13.095249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.148680 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa42693-b951-4539-8383-a877eab0070d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.156242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.184854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.185494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.186027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.186027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.197496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.199022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:13.214610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:13.215562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:13.216482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:13.216482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:13.216482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:13.216482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 421/852] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:13.216482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.222115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.223700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800254d1-e513-4b21-a6b5-bd48abf92e53 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.259637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.260254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.260534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.260808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.261614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:13.262090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.263513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.268310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 432/853] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:13.268901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.359138 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a004b578-09a3-4acd-a40e-de102cdfd256 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.381650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb8be87-e53b-48a6-97e7-d618f93aef63 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.394741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.407163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.407867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.408150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.408423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.417219 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.418752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.427910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.428849 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.429323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.429786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.430667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:13.431161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:13.431876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:13.432763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:13.433764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 422/854] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:13.435786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.439518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.448731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 433/855] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:13.454343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.518328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.561985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3619ac3e-35a9-42f4-a49b-592a59e63a88 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.572420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0874f75-78fb-456f-93e9-659ac49c12e1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.598554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.599349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.599725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.600086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.608443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.610106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.616356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.617436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.617865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.618314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.619193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:13.619663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.621442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:13.623573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:13.624725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:13.625909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:13.632717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 434/856] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:13.633862 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.658764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 423/857] 10.222.0.39 () {56 vars in 1135 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:13.659612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.675154 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.767762 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f5810e-a447-45d2-b955-11268d85330d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.768479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218ad66a-b1c8-470e-be32-c1c090aed896 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:13.797585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.807405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.808011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.808291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.808652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.809393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:13.809696 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.811384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.814227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:13.816132 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:13.816576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:13.816996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:13.836271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 435/858] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:13.837311 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:13.901501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:13.903108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:13.955026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:13.970601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5604fb-275e-4c00-a0e9-c10868b23556 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.011264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.012046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.012421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.012790 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.013417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 424/859] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:04:14.018843 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.044578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.092704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.094845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.135693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a88a3-7e7e-4d3f-a93e-ee0c62a9e267 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.172790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.173355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.173630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.173897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.185282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.186917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.189541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:14.204476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:14.205486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:14.206412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:14.206412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:14.206412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:14.206412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 425/860] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:14.206637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 436/861] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:13 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:14.208522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.219054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.296192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.322758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861b4139-e677-415e-bc15-012cc7569c8d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.327404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60953430-0e86-4ec3-957c-369e76222c95 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.359248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.359887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.360162 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.360432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.365956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.366901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.367513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.367891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.368613 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:14.368983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.370618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.372707 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.374467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.388056 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 437/862] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:14.389203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:14.389727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:14.390804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:14.391708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:14.391708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:14.391708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:14.395214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 426/863] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:14.400989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.450579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.503628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff47267f-2202-4a61-83f5-dbdf5507f4e4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.523268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaf03a-b52e-47fc-85a1-7d43ad0450e2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.539241 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9823c-1493-4502-8ea3-d8d96ceec485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.539873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9823c-1493-4502-8ea3-d8d96ceec485 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.540146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9823c-1493-4502-8ea3-d8d96ceec485 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.540422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9823c-1493-4502-8ea3-d8d96ceec485 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.547772 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9823c-1493-4502-8ea3-d8d96ceec485 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.549226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdc9823c-1493-4502-8ea3-d8d96ceec485 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.551224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cdc9823c-1493-4502-8ea3-d8d96ceec485 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:14.560913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:14.561843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:14.563690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:14.564123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e37ea5-ab09-482d-8784-281544b35ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.564123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37ea5-ab09-482d-8784-281544b35ebe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.564280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 438/864] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:14.564280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb76d1-83f9-4a67-852a-7d0743c865d0 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.564280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb76d1-83f9-4a67-852a-7d0743c865d0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.564461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4deb76d1-83f9-4a67-852a-7d0743c865d0 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.569881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 439/865] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:14.570015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37ea5-ab09-482d-8784-281544b35ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.570015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e37ea5-ab09-482d-8784-281544b35ebe None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.570177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb76d1-83f9-4a67-852a-7d0743c865d0 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.570248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37ea5-ab09-482d-8784-281544b35ebe None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:14.570248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37ea5-ab09-482d-8784-281544b35ebe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.570384 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e37ea5-ab09-482d-8784-281544b35ebe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.584619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 427/866] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:14.587395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06bb91-cf40-4812-8224-3a669a4d63b3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.587655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06bb91-cf40-4812-8224-3a669a4d63b3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.587934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f06bb91-cf40-4812-8224-3a669a4d63b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.605867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6f06bb91-cf40-4812-8224-3a669a4d63b3 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:14.607087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6f06bb91-cf40-4812-8224-3a669a4d63b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:14.678091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 428/867] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:14 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:14.678091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06bb91-cf40-4812-8224-3a669a4d63b3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.693116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4deb76d1-83f9-4a67-852a-7d0743c865d0 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.704806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.733092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.733698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.733974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.734284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.734964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:14.735258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.736689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.749623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 440/868] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:14.750450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.783821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f06bb91-cf40-4812-8224-3a669a4d63b3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.800330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.819923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.820577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.820883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.821110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.828265 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.829718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:14.840972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:14.841989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 429/869] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:14.842906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.859748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50de3a6-96e6-469b-9ab2-0d15be32c173 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:14.896228 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:14.896836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:14.897110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:14.897376 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:14.898008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:14.899395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:14.926087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 441/870] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:14 2022] POST /identity/v3/services => generated 251 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:14.926087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:14.959636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:14.965199 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde2b1eb-2e5d-4ac0-8a32-196e1b665b58 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:15.012810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:15.013438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:15.013714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:15.013990 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:15.014773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=d6ee2855740e4797afb4843d04446870) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:15.015094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:15.016647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:15.023938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 430/871] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/role_assignments?user.id=d6ee2855740e4797afb4843d04446870&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:15.046043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ef436-c22c-4f93-b96e-c62adb8843d9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:15.087332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f37c92e-b4dd-425b-85e4-3f8cfabf00e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:15.087965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37c92e-b4dd-425b-85e4-3f8cfabf00e2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:15.088383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37c92e-b4dd-425b-85e4-3f8cfabf00e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:15.088652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f37c92e-b4dd-425b-85e4-3f8cfabf00e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:15.089559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37c92e-b4dd-425b-85e4-3f8cfabf00e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:15.090223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37c92e-b4dd-425b-85e4-3f8cfabf00e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:15.091348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f37c92e-b4dd-425b-85e4-3f8cfabf00e2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:15.106793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 442/872] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:15.113022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:15.161492 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:15.233870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8907c6-d1ba-4b45-9706-8150952001fe None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:15.268629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5d165d-6192-400b-ab07-5c866ba781c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:15.269246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d165d-6192-400b-ab07-5c866ba781c3 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:15.269525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d165d-6192-400b-ab07-5c866ba781c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:15.269800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5d165d-6192-400b-ab07-5c866ba781c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:15.270561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d165d-6192-400b-ab07-5c866ba781c3 None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=091efb05bd0b47fd87d3641bf7354284) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:15.270868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d165d-6192-400b-ab07-5c866ba781c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:15.272297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5d165d-6192-400b-ab07-5c866ba781c3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:15.280009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 431/873] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:15 2022] GET /identity/v3/role_assignments?user.id=091efb05bd0b47fd87d3641bf7354284&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:15.307409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d33e-c3bf-4382-ac9e-3b5c65bb2d5a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:15.307771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d33e-c3bf-4382-ac9e-3b5c65bb2d5a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:15.308293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e7d33e-c3bf-4382-ac9e-3b5c65bb2d5a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:15.309579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 443/874] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:15.315840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a3ba-d501-4f2d-b205-4701b3792734 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:15.316164 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a3ba-d501-4f2d-b205-4701b3792734 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:15.316444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1937a3ba-d501-4f2d-b205-4701b3792734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:15.337507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1937a3ba-d501-4f2d-b205-4701b3792734 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:15.338847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1937a3ba-d501-4f2d-b205-4701b3792734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:15.414342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 432/875] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:15 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:15.436969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d33e-c3bf-4382-ac9e-3b5c65bb2d5a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:15.531592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:15.545390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e7d33e-c3bf-4382-ac9e-3b5c65bb2d5a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:15.583182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573565d-d603-4712-bc8c-ca881ef61005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:15.584050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573565d-d603-4712-bc8c-ca881ef61005 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:15.584469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573565d-d603-4712-bc8c-ca881ef61005 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:15.584878 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573565d-d603-4712-bc8c-ca881ef61005 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:15.585714 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573565d-d603-4712-bc8c-ca881ef61005 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:15.587312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573565d-d603-4712-bc8c-ca881ef61005 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:15.608353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 444/876] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:15 2022] POST /identity/v3/services => generated 269 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:17.038687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59efc9-5024-40f9-8097-5bc4e2262186 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.039268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59efc9-5024-40f9-8097-5bc4e2262186 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.039268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59efc9-5024-40f9-8097-5bc4e2262186 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.040810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 433/877] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:17.046465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb988-da93-4705-84e1-64ee2a7d0f5b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.046958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb988-da93-4705-84e1-64ee2a7d0f5b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.047204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bb988-da93-4705-84e1-64ee2a7d0f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.065856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ec3bb988-da93-4705-84e1-64ee2a7d0f5b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:17.067067 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ec3bb988-da93-4705-84e1-64ee2a7d0f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:17.144062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 445/878] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:17.164273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e398b-5e2d-4f10-a5da-e63551dfbb2d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.164588 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e398b-5e2d-4f10-a5da-e63551dfbb2d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.165036 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e398b-5e2d-4f10-a5da-e63551dfbb2d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.165995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bb988-da93-4705-84e1-64ee2a7d0f5b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.166779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 434/879] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:17.172127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e5d6-0786-48c6-929a-afabdcdffcdd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.172486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e5d6-0786-48c6-929a-afabdcdffcdd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.172833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f10e5d6-0786-48c6-929a-afabdcdffcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.192494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1f10e5d6-0786-48c6-929a-afabdcdffcdd None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:17.193913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1f10e5d6-0786-48c6-929a-afabdcdffcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:17.219987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:17.257068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:17.293253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bb988-da93-4705-84e1-64ee2a7d0f5b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.294326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 435/880] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:17.307732 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10e5d6-0786-48c6-929a-afabdcdffcdd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.336532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.337674 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.338368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.338784 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.340393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:17.341953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:17.354075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:17.355637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:17.356500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:17.362196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 446/881] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:17.365478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.419656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f10e5d6-0786-48c6-929a-afabdcdffcdd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.456625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fe2825-1f98-4c46-9b48-f434450611e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.457268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe2825-1f98-4c46-9b48-f434450611e5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.457545 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe2825-1f98-4c46-9b48-f434450611e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.457814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fe2825-1f98-4c46-9b48-f434450611e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.458438 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe2825-1f98-4c46-9b48-f434450611e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:17.459806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fe2825-1f98-4c46-9b48-f434450611e5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:17.468920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd63dba9-5939-42f1-bd9b-cbc5f0b76fb5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-c8fe2825-1f98-4c46-9b48-f434450611e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:17.469040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:17.469964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:17.471119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:17.474362 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 436/882] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:17.475854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cec0d-ddd1-492f-a5e2-dcdc682ee0a1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.476138 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cec0d-ddd1-492f-a5e2-dcdc682ee0a1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.476443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cec0d-ddd1-492f-a5e2-dcdc682ee0a1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.477837 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 437/883] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:17.482424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cec0d-ddd1-492f-a5e2-dcdc682ee0a1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.505049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb8467-543c-4dd5-b673-55c498d21c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.505660 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8467-543c-4dd5-b673-55c498d21c6e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.505942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8467-543c-4dd5-b673-55c498d21c6e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.506237 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb8467-543c-4dd5-b673-55c498d21c6e None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.506855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb8467-543c-4dd5-b673-55c498d21c6e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:17.507160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb8467-543c-4dd5-b673-55c498d21c6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:17.508267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:17.508525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb8467-543c-4dd5-b673-55c498d21c6e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:17.517964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 447/884] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:17.519279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883c92b-47f8-4f99-ae5d-1b509213e089 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.519560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883c92b-47f8-4f99-ae5d-1b509213e089 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.519835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7883c92b-47f8-4f99-ae5d-1b509213e089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.526002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:17.539522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7883c92b-47f8-4f99-ae5d-1b509213e089 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:17.540706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7883c92b-47f8-4f99-ae5d-1b509213e089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:17.590767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cec0d-ddd1-492f-a5e2-dcdc682ee0a1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.610099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 448/885] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:17.610948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883c92b-47f8-4f99-ae5d-1b509213e089 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.636416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.637050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.637312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.637604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.638270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:17.638574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:17.639942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:17.645229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 438/886] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:17.649944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.718442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7883c92b-47f8-4f99-ae5d-1b509213e089 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.742451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:17.751143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:17.756441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.757051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.757327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.757596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.757840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf5da13-baff-4914-b455-e958bb3fa733 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.758258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:17.758558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:17.759969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:17.764970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 449/887] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:17.765740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.793306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95f83eb-93fa-428c-adf1-df365f58c8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.793934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f83eb-93fa-428c-adf1-df365f58c8e8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.794237 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f83eb-93fa-428c-adf1-df365f58c8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.794506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f83eb-93fa-428c-adf1-df365f58c8e8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.804817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95f83eb-93fa-428c-adf1-df365f58c8e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-e95f83eb-93fa-428c-adf1-df365f58c8e8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:17.809869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:17.810861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:17.811809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 439/888] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:17.812501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727465-58cb-4956-84d3-79b30b71b8f7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.813174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727465-58cb-4956-84d3-79b30b71b8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.813338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad727465-58cb-4956-84d3-79b30b71b8f7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.814563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 440/889] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:17.815234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727465-58cb-4956-84d3-79b30b71b8f7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.869383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc621b-01fd-492b-bdbe-491c9cbef834 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.902970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.903563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.903839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.904104 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.904723 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:17.905018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:17.906423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:17.910816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 450/890] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:17.911571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:17.925128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad727465-58cb-4956-84d3-79b30b71b8f7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:17.965977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6b5c5b-d99c-4202-a75b-8cd4d745f125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:17.966786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5c5b-d99c-4202-a75b-8cd4d745f125 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.967069 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5c5b-d99c-4202-a75b-8cd4d745f125 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.967361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6b5c5b-d99c-4202-a75b-8cd4d745f125 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.968082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b5c5b-d99c-4202-a75b-8cd4d745f125 None admin] RBAC: Adding query filter params (interface=public, service_id=c8b88f86561c42ac9cfe61193f5a8b2b, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:17.968393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b5c5b-d99c-4202-a75b-8cd4d745f125 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:17.969857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6b5c5b-d99c-4202-a75b-8cd4d745f125 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:17.980523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 441/891] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/endpoints?service_id=c8b88f86561c42ac9cfe61193f5a8b2b&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:17.981999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb98-ee49-4cde-88a9-e0fa38c3f1f4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:17.982312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb98-ee49-4cde-88a9-e0fa38c3f1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:17.982589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4ecb98-ee49-4cde-88a9-e0fa38c3f1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:17.982722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.003050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ad4ecb98-ee49-4cde-88a9-e0fa38c3f1f4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:18.004277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ad4ecb98-ee49-4cde-88a9-e0fa38c3f1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:18.013785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.030390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79170fd4-d973-4b53-96b3-d9750440fd0b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.070918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.072358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.072358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.072358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.072811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:18.073113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.074732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.088497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 451/892] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Aug 8 01:04:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:18.089865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.090661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 442/893] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:18.092003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecb98-ee49-4cde-88a9-e0fa38c3f1f4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.203483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3127617-705f-4f80-b45f-f19f6cadf231 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.222140 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4ecb98-ee49-4cde-88a9-e0fa38c3f1f4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.228520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.242863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.243820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.244235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.244640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.245628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.247289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.262093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.262093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.262093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.262093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.263102 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 452/894] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/services => generated 1268 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:04:18.264241 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.277522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.280092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:18.307133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:18.308190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:18.309086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:18.309086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:18.309086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:18.309705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 443/895] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:18.310147 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.316450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.419829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e4cf1f-459a-437a-99ca-fbea0c1dc893 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.431709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d74a3-80f8-485a-b896-1b78e653b4f2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.468788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.469682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.470137 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.470603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.471338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.472747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.473206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.473903 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.474245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.474787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.475723 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:18.476036 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.477656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:18.481934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:18.482958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:18.483865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 453/896] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:18.491978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.496402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 444/897] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:18.501870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.562225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.564344 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.611546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f21a68-fcfb-4566-b5c0-e6a6a5821db7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.634686 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc1fe45-0f56-44a7-ae70-78b0c893416e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.650656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.651663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.652094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.652502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.660229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.661876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:18.674404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:18.675541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:18.676785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:18.678034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.678840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.683763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.683763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.683763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:18.683763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.683763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.684502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 445/898] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:18.685807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.690142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 454/899] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:18.694358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.795190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19962864-e5b6-4f0b-a68f-33e6f92ac512 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.810110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.828608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60309992-3f03-4b33-8db2-60e01799d55f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:18.841433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.842621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.843459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:18.844273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.844752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.846092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:18.846544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.848643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.869231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:18.870006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:18.870445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:18.870831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:18.871549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:18.871940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:18.873186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 446/900] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:18.874077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:18.878584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.880816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 455/901] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:18.890986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:18.998817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99854014-4a32-4647-b65f-4f2ed103ab26 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:19.007307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab7154-ea4c-4400-acbe-b2ab42072de6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:19.035476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:19.036455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.036957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.037381 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.038254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] RBAC: Adding query filter params (interface=public, service_id=eb67e05213be4d019f475d336644e630, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:19.038711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:19.040487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:19.051094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23934917-115e-40a3-9310-45dea489f674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:19.051094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23934917-115e-40a3-9310-45dea489f674 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.051094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23934917-115e-40a3-9310-45dea489f674 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.051094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23934917-115e-40a3-9310-45dea489f674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.052006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 456/902] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/endpoints?service_id=eb67e05213be4d019f475d336644e630&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:19.053113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:19.100978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:19.105866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:19.143908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23934917-115e-40a3-9310-45dea489f674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:19.145503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23934917-115e-40a3-9310-45dea489f674 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:19.176707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4148e-6b43-49e1-aeee-1c1210816dcf None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:19.213798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:19.214721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.215139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.215612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.216386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:19.217987 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:19.230749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 457/903] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:19 2022] GET /identity/v3/services => generated 1268 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:04:19.269233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 447/904] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:18 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:04:19.275418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:19.390509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceedb2bc-0ce5-4087-8057-24c9e6db486f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:19.399010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:19.429270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:19.429906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.430258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.430530 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.442375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:19.443825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:19.458465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:19.459436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:19.460330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:19.460330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:19.460330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:19.460330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 458/905] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:19.465350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23934917-115e-40a3-9310-45dea489f674 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:19.536587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:19.567804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23934917-115e-40a3-9310-45dea489f674 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:19.602472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:19.603084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.603359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.603629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.604270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:19.604599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:19.605952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:19.617912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 448/906] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:19.623479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:19.727125 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f16291-f1e0-46bd-815b-5f11817c81b1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:19.763038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc47786f-5326-454c-9c4d-1ed7f22fd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:19.763936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47786f-5326-454c-9c4d-1ed7f22fd542 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.764394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47786f-5326-454c-9c4d-1ed7f22fd542 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.764811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc47786f-5326-454c-9c4d-1ed7f22fd542 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.772281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47786f-5326-454c-9c4d-1ed7f22fd542 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:19.773920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc47786f-5326-454c-9c4d-1ed7f22fd542 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-cc47786f-5326-454c-9c4d-1ed7f22fd542 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:19.786452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:19.787636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:19.788778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:19.790819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 459/907] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:19.798109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:19.906565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa652d11-7fb9-4fa0-b044-0fc2fcc5a036 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:19.940206 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:19.942328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:19.942992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.945609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.945609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.945609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:19.945609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:19.946006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:19.954676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4cb86-33c8-4722-9cbe-bb67cf7bc755 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.954978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4cb86-33c8-4722-9cbe-bb67cf7bc755 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.955213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb4cb86-33c8-4722-9cbe-bb67cf7bc755 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.956537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 460/908] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:19.959988 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 449/909] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:19.961555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f101bc-38e5-47b8-a710-f1d1bfa538c7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:19.961834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f101bc-38e5-47b8-a710-f1d1bfa538c7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:19.962133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f101bc-38e5-47b8-a710-f1d1bfa538c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:19.966098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:19.985318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a0f101bc-38e5-47b8-a710-f1d1bfa538c7 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:19.986884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a0f101bc-38e5-47b8-a710-f1d1bfa538c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:20.002619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:20.066423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 461/910] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:19 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:20.072495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0578b6-2550-44bd-986a-c1b87b7502c4 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:20.084118 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f101bc-38e5-47b8-a710-f1d1bfa538c7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:20.116017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f58102-13e0-4826-af1f-9bbd3877b01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:20.116668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58102-13e0-4826-af1f-9bbd3877b01e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:20.116961 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58102-13e0-4826-af1f-9bbd3877b01e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:20.117236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f58102-13e0-4826-af1f-9bbd3877b01e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:20.118266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f58102-13e0-4826-af1f-9bbd3877b01e None admin] RBAC: Adding query filter params (role.id=3a0564cda74d4c538041631392b37a8f, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=091efb05bd0b47fd87d3641bf7354284) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:20.118578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f58102-13e0-4826-af1f-9bbd3877b01e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:20.120160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f58102-13e0-4826-af1f-9bbd3877b01e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:20.128027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 450/911] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:19 2022] GET /identity/v3/role_assignments?user.id=091efb05bd0b47fd87d3641bf7354284&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=3a0564cda74d4c538041631392b37a8f => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:20.202543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f101bc-38e5-47b8-a710-f1d1bfa538c7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:20.241552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de27154-1b0f-4670-ba5e-44a595102948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:20.242509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27154-1b0f-4670-ba5e-44a595102948 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:20.242928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27154-1b0f-4670-ba5e-44a595102948 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:20.243400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27154-1b0f-4670-ba5e-44a595102948 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:20.244198 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de27154-1b0f-4670-ba5e-44a595102948 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:20.245858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de27154-1b0f-4670-ba5e-44a595102948 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:20.265866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 462/912] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:20 2022] POST /identity/v3/services => generated 241 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:04:20.367028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25021c-cd92-4cab-92bf-bbe98ea35af8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:20.367217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25021c-cd92-4cab-92bf-bbe98ea35af8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:20.367521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac25021c-cd92-4cab-92bf-bbe98ea35af8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:20.369155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 451/913] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:20.374870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f304-69cf-4e91-b436-15597c5bccee None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:20.375147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f304-69cf-4e91-b436-15597c5bccee None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:20.375420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a801f304-69cf-4e91-b436-15597c5bccee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:20.395070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a801f304-69cf-4e91-b436-15597c5bccee None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:20.396296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a801f304-69cf-4e91-b436-15597c5bccee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:20.398955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:20.482835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 463/914] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:20 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:20.505846 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25021c-cd92-4cab-92bf-bbe98ea35af8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:20.571280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:20.620730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac25021c-cd92-4cab-92bf-bbe98ea35af8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:20.655678 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:20.656359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:20.656639 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:20.656905 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:20.657491 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:20.658876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:20.668294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:20.669271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:20.670114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 452/915] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:20 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:20.675543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801f304-69cf-4e91-b436-15597c5bccee None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:20.775913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a801f304-69cf-4e91-b436-15597c5bccee None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:20.814279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:20.815285 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:20.815755 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:20.816237 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:20.817072 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:20.817564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:20.819214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:20.820565 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:20.826222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 464/916] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:20 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:20.838085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:20.939311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b983d8c4-e4f5-476e-a56a-c165cb9b82eb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:20.959115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:20.974627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb6ca40-3f8b-47c7-b034-82fa13d58f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:20.975240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6ca40-3f8b-47c7-b034-82fa13d58f96 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:20.975517 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6ca40-3f8b-47c7-b034-82fa13d58f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:20.975785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb6ca40-3f8b-47c7-b034-82fa13d58f96 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:20.976413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6ca40-3f8b-47c7-b034-82fa13d58f96 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:20.976766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6ca40-3f8b-47c7-b034-82fa13d58f96 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:20.978164 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb6ca40-3f8b-47c7-b034-82fa13d58f96 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:20.983479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 453/917] 10.222.0.39 () {56 vars in 1114 bytes} [Mon Aug 8 01:04:20 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:20.988966 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:21.093518 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d7cb33-d114-4383-9378-207a16985277 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:21.129644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af9ea09-df13-42ed-bdf9-a86da5777a6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:21.130281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ea09-df13-42ed-bdf9-a86da5777a6b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:21.130563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ea09-df13-42ed-bdf9-a86da5777a6b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:21.130827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af9ea09-df13-42ed-bdf9-a86da5777a6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:21.131497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ea09-df13-42ed-bdf9-a86da5777a6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:21.132874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af9ea09-df13-42ed-bdf9-a86da5777a6b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:21.159224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 465/918] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:20 2022] POST /identity/v3/endpoints => generated 346 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:21.422959 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8366d-9754-4d87-b9b1-8d595b391537 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:21.423490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8366d-9754-4d87-b9b1-8d595b391537 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:21.423490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b8366d-9754-4d87-b9b1-8d595b391537 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:21.425106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 454/919] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:21.430572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2d244-3c01-4737-a238-6137dfa36463 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:21.431004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2d244-3c01-4737-a238-6137dfa36463 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:21.431191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c2d244-3c01-4737-a238-6137dfa36463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:21.449988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-98c2d244-3c01-4737-a238-6137dfa36463 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:21.451207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-98c2d244-3c01-4737-a238-6137dfa36463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:21.504830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:21.538190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 466/920] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:21 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:21.553596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8366d-9754-4d87-b9b1-8d595b391537 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:21.660010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b8366d-9754-4d87-b9b1-8d595b391537 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:21.695061 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:21.695746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:21.696030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:21.696302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:21.696891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:21.698356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:21.707328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:21.709428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 08 01:04:21.711526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:21.718205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 455/921] 10.222.0.39 () {56 vars in 1132 bytes} [Mon Aug 8 01:04:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:21.718410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2d244-3c01-4737-a238-6137dfa36463 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:21.821201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c2d244-3c01-4737-a238-6137dfa36463 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:21.856461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:21.857070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:21.857345 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:21.857614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:21.858268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:21.858565 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:21.859939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:21.865297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 467/922] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:21.871473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:21.942465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:21.987071 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f890b614-0e8b-4bf5-8661-775dc0c23dd0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:22.022332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74dbe94-29d4-401c-ba1e-5d57b4c5204c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:22.022941 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dbe94-29d4-401c-ba1e-5d57b4c5204c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.023223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dbe94-29d4-401c-ba1e-5d57b4c5204c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.023484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74dbe94-29d4-401c-ba1e-5d57b4c5204c None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.024114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dbe94-29d4-401c-ba1e-5d57b4c5204c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:22.024411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dbe94-29d4-401c-ba1e-5d57b4c5204c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:22.025764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74dbe94-29d4-401c-ba1e-5d57b4c5204c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:22.035840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 456/923] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:21 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:22.037195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:22.084825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:22.142792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09b888-f861-4bde-99c0-18a2e1fc4abd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:22.177461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:22.178380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.178814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.179321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.180221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:22.181847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:22.187405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07b38-2808-4e22-b0c8-543c2a3ddbf9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.188111 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07b38-2808-4e22-b0c8-543c2a3ddbf9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.188442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de07b38-2808-4e22-b0c8-543c2a3ddbf9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.190169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 457/924] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:22.195291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49cb8a-4493-412f-894b-d9df6946b91d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.195629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49cb8a-4493-412f-894b-d9df6946b91d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.195898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d49cb8a-4493-412f-894b-d9df6946b91d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.210920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 468/925] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:22 2022] POST /identity/v3/endpoints => generated 347 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:22.226676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4d49cb8a-4493-412f-894b-d9df6946b91d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:22.228496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4d49cb8a-4493-412f-894b-d9df6946b91d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:22.320629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 458/926] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:22.343277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:22.451975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:22.455916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f899a55f-7ccc-4d0d-aa03-0553c70c0b5d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:22.463505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f81734-dd82-43d7-99fb-6f5544f7c102 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.464076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f81734-dd82-43d7-99fb-6f5544f7c102 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.464177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f81734-dd82-43d7-99fb-6f5544f7c102 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.465641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 459/927] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:22.470655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8767-c9be-4de4-bdc7-59563482efe5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.470879 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8767-c9be-4de4-bdc7-59563482efe5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.471150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580a8767-c9be-4de4-bdc7-59563482efe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.488927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-580a8767-c9be-4de4-bdc7-59563482efe5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:22.490112 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-580a8767-c9be-4de4-bdc7-59563482efe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:22.497320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:22.498644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.499099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.499541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.513076 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:22.521360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:22.522405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:22.523336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:22.524067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:22.526379 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 469/928] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Aug 8 01:04:22 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:22.535081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:22.568580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 460/929] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:22 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:22.590816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a8767-c9be-4de4-bdc7-59563482efe5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:22.654186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63e2f6-fe52-42ad-ba8b-74a66415ad12 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:22.691177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:22.692290 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.692870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.693361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.694275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:22.694785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:22.696453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:22.706223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 470/930] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Aug 8 01:04:22 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:22.711916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:22.714284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580a8767-c9be-4de4-bdc7-59563482efe5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:22.744389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:22.753019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:22.753666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.753938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.754251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.754943 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:22.756285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:22.766605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:22.767704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:22.768564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:22.772981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 461/931] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:22.773975 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:22.808810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:22.849427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89263518-94fe-42f7-b7c4-a17d196c53cc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:22.885518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e58ff5-c2ec-4763-9210-827cd2c68e4c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:22.894140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:22.895176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.895667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.896562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.913458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:22.915636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:22.921645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:22.922296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:22.922580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:22.922838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:22.923462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:22.923757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:22.925104 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:22.935024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 462/932] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:22.935977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:22.936953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:22.938277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:22.939188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:22.939188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:22.939188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:22.947264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 471/933] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:22.948820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.041424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.048115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0e083f-398a-4c37-a246-7c54a550e701 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.055993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.089811 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.090474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61244d66-5a0b-4099-937c-6a86c5c08f96 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.091060 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.091506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.091927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.093998 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:23.094476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.095995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.103299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 463/934] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:22 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:23.114394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.144255 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.144865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.145185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.145455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.146272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:23.146630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.148557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.163270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 472/935] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:23.169197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.230909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bedaf85-c05f-47b3-9aaa-336aea8e4db6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.264890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c5bf8-1c16-4183-bb4c-1dd7b0abf24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.265502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5bf8-1c16-4183-bb4c-1dd7b0abf24f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.265779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5bf8-1c16-4183-bb4c-1dd7b0abf24f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.266063 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c5bf8-1c16-4183-bb4c-1dd7b0abf24f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.266778 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5bf8-1c16-4183-bb4c-1dd7b0abf24f None admin] RBAC: Adding query filter params (interface=public, service_id=127c060644e64903aaaa772aaaba42e9, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:23.267078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5bf8-1c16-4183-bb4c-1dd7b0abf24f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.268436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061c5bf8-1c16-4183-bb4c-1dd7b0abf24f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.273355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 464/936] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/endpoints?service_id=127c060644e64903aaaa772aaaba42e9&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:23.273932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b759b4a-9e15-4d52-8c92-b95ee1b73389 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.274611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0be383-5179-436a-9aaa-3c4cdc90ddf7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.274897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0be383-5179-436a-9aaa-3c4cdc90ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.275169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0be383-5179-436a-9aaa-3c4cdc90ddf7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.276648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 465/937] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:23.281398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0be383-5179-436a-9aaa-3c4cdc90ddf7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.309803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.314881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da66fd-1247-429e-a4d4-90a00e110010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.315515 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da66fd-1247-429e-a4d4-90a00e110010 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.315793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da66fd-1247-429e-a4d4-90a00e110010 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.316061 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da66fd-1247-429e-a4d4-90a00e110010 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.318110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.325473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da66fd-1247-429e-a4d4-90a00e110010 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.327029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da66fd-1247-429e-a4d4-90a00e110010 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-74da66fd-1247-429e-a4d4-90a00e110010 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:23.339703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:23.340831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:23.341779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 473/938] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:23.342430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef18f0-af73-4e7f-8cb9-9c8b258b3443 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.342430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef18f0-af73-4e7f-8cb9-9c8b258b3443 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.342562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef18f0-af73-4e7f-8cb9-9c8b258b3443 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.360883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a3ef18f0-af73-4e7f-8cb9-9c8b258b3443 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:23.361997 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3ef18f0-af73-4e7f-8cb9-9c8b258b3443 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:23.396462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0be383-5179-436a-9aaa-3c4cdc90ddf7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.434120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 474/939] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:23.435353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef18f0-af73-4e7f-8cb9-9c8b258b3443 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.446999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.447734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.448055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.448484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.449108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.450572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.466275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 466/940] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/services => generated 1497 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:04:23.467260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.573669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef18f0-af73-4e7f-8cb9-9c8b258b3443 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.582850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.598512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6fd743-01a0-46b2-948f-b6c25c52a7c7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.612058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.625517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.626380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.626808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.627090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.627844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:23.628149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.629579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.640002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.640910 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.641375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.641816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.642651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.644293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.647136 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING keystone.server.flask.common [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 01:04:23.648067 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 475/941] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:23.654430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.676009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.sql.core [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 01:04:23.676009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 01:04:23.676009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [parameters: {'id': 'e152042a15f74c71b47e89b7da74d3af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 01:04:23.676009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80318) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e152042a15f74c71b47e89b7da74d3af.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e152042a15f74c71b47e89b7da74d3af. Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application conn.query(q) Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 01:04:23.698156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application result.read() Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 08 01:04:23.699345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application next(self.gen) Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application yield resource Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application next(self.gen) Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise self.value Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application session.commit() Aug 08 01:04:23.700283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.session.flush() Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application compat.raise_( Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 01:04:23.701161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 01:04:23.702279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application conn.query(q) Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application result.read() Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 01:04:23.703229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [parameters: {'id': 'e152042a15f74c71b47e89b7da74d3af', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:23.704357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:23.705342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id e152042a15f74c71b47e89b7da74d3af. Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.706681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 467/942] 10.222.0.39 () {60 vars in 1140 bytes} [Mon Aug 8 01:04:23 2022] POST /identity/v3/projects => generated 262 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:23.714121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.770811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919da687-7310-4fdf-b4f2-c52f4319584d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.808853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.809615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.809958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.810317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.823171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.824984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.843373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a330d6-49a4-49e8-a19d-16e98b2f8766 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:23.843747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:23.845521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:23.847596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:23.847596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:23.847596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:23.850934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 476/943] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:23.854073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.885802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:23.887272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:23.887554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:23.887824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:23.889434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.897741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:23.901085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:23.917715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:23.918918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:23.920032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:23.927704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 468/944] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:23.930198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:23.937241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:23.991227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725ea398-6df2-4192-94df-4293f0dfcdcb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.027965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.028587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.028863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.029135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.029785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:24.030124 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.031596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:24.041526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a656294-7c5f-4cf4-baab-d3e11016b346 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.044351 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 477/945] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:24.049908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:24.077411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.078030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.078331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.078598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.079267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:24.079562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.080972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:24.102383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 469/946] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:23 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:24.162881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:24.171360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3ae216-73ca-4ed5-ab15-a19581d080e6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.211426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3e1c23-0dc4-45c9-a237-d45292ae9470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.212083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e1c23-0dc4-45c9-a237-d45292ae9470 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.212362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e1c23-0dc4-45c9-a237-d45292ae9470 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.212633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3e1c23-0dc4-45c9-a237-d45292ae9470 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.220843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e1c23-0dc4-45c9-a237-d45292ae9470 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.222471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3e1c23-0dc4-45c9-a237-d45292ae9470 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6d3e1c23-0dc4-45c9-a237-d45292ae9470 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:24.235282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:24.237521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:24.239770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 478/947] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:24.243249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:24.311657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:24.316142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50457ac-7086-41e0-aa37-13ac4f8095a9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.316419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50457ac-7086-41e0-aa37-13ac4f8095a9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.316688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50457ac-7086-41e0-aa37-13ac4f8095a9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.321738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 479/948] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:24.324369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27b501-b615-4dff-988e-3c73333492ec None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.324806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27b501-b615-4dff-988e-3c73333492ec None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.325143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd27b501-b615-4dff-988e-3c73333492ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.351769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dd27b501-b615-4dff-988e-3c73333492ec None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:24.352836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dd27b501-b615-4dff-988e-3c73333492ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:24.366232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6a1586-855c-4f0b-9a4a-ac8a33e303da None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.409318 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.410208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.410622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.411046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.411872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:24.412323 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.413939 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:24.426388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 470/949] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:24.432513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:24.451782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 480/950] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:24.473878 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27b501-b615-4dff-988e-3c73333492ec None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:24.550909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3474b431-ebab-47c9-986e-22894f6ea18a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.576043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:24.584650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:24.589665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.590525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.590893 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.591297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/091efb05bd0b47fd87d3641bf7354284/roles/3a0564cda74d4c538041631392b37a8f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.594017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=091efb05bd0b47fd87d3641bf7354284, role_id=3a0564cda74d4c538041631392b37a8f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.595892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:24.606070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd27b501-b615-4dff-988e-3c73333492ec None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.614095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 471/951] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:04:24 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/091efb05bd0b47fd87d3641bf7354284/roles/3a0564cda74d4c538041631392b37a8f => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:04:24.662107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.662828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.663110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.663388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.664110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.665498 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:24.676206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:24.677293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:24.678166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 481/952] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:24 2022] GET /identity/v3/services/compute => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:24.686614 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:24.798550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1d4178-7357-491e-8e05-4680c4260739 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.836879 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9a3b86-5823-4fc3-b606-5573a4c88fc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.837872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a3b86-5823-4fc3-b606-5573a4c88fc6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.838377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a3b86-5823-4fc3-b606-5573a4c88fc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.839105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9a3b86-5823-4fc3-b606-5573a4c88fc6 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.840038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a3b86-5823-4fc3-b606-5573a4c88fc6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:24.840549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a3b86-5823-4fc3-b606-5573a4c88fc6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.842147 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9a3b86-5823-4fc3-b606-5573a4c88fc6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:24.847928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 472/953] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:24 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:24.853459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:24.959569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265903d-268e-4924-8653-3132446b2e90 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:24.995593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a645b9-30c6-4625-809c-b6e4959dbd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:24.996325 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a645b9-30c6-4625-809c-b6e4959dbd29 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:24.996601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a645b9-30c6-4625-809c-b6e4959dbd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:24.996873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a645b9-30c6-4625-809c-b6e4959dbd29 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:24.997515 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a645b9-30c6-4625-809c-b6e4959dbd29 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:24.997817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a645b9-30c6-4625-809c-b6e4959dbd29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:24.999222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a645b9-30c6-4625-809c-b6e4959dbd29 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:25.004313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 482/954] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:24 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:25.564262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e914f-201a-4275-80ec-b8f209dee415 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:25.564825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e914f-201a-4275-80ec-b8f209dee415 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:25.564825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e914f-201a-4275-80ec-b8f209dee415 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:25.566450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 473/955] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:25.571652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513022-75f8-49ce-ad35-50bf8a5e422c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:25.572038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513022-75f8-49ce-ad35-50bf8a5e422c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:25.572399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e513022-75f8-49ce-ad35-50bf8a5e422c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:25.590576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6e513022-75f8-49ce-ad35-50bf8a5e422c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:25.591886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e513022-75f8-49ce-ad35-50bf8a5e422c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:25.599870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:25.662289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 483/956] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:25.684572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e914f-201a-4275-80ec-b8f209dee415 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:25.739129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:25.793592 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e914f-201a-4275-80ec-b8f209dee415 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:25.831368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:25.832304 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:25.832792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:25.833253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:25.834013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:25.835567 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:25.844760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:25.845994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:25.846929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:25.849366 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 474/957] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:25.855137 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e513022-75f8-49ce-ad35-50bf8a5e422c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:25.962078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e513022-75f8-49ce-ad35-50bf8a5e422c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:25.997393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:25.998304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:25.998814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:25.999245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.000018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:26.000474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:26.002004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:26.007484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 484/958] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:26.013437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:26.118020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2612f2b6-8c38-47c5-949f-f0f7301c31af None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:26.153516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c26dc-dc95-4617-bb9a-19a7c9bc6c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:26.154166 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c26dc-dc95-4617-bb9a-19a7c9bc6c3b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.154495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c26dc-dc95-4617-bb9a-19a7c9bc6c3b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.154772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c26dc-dc95-4617-bb9a-19a7c9bc6c3b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.155406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c26dc-dc95-4617-bb9a-19a7c9bc6c3b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:26.155705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c26dc-dc95-4617-bb9a-19a7c9bc6c3b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:26.157127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c26dc-dc95-4617-bb9a-19a7c9bc6c3b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:26.162387 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:26.162648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 475/959] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:26.171222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:26.180305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:26.275201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0405e9ab-f282-409b-b22b-0698d248b0ab None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:26.278929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566850ce-58e2-48b1-b5dc-63db3b86f739 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.279210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566850ce-58e2-48b1-b5dc-63db3b86f739 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.279481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566850ce-58e2-48b1-b5dc-63db3b86f739 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.281135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 476/960] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:26.286174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f60b-0682-472f-ad5b-dc62b9d9716b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.286311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f60b-0682-472f-ad5b-dc62b9d9716b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.286487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1121f60b-0682-472f-ad5b-dc62b9d9716b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.304807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1121f60b-0682-472f-ad5b-dc62b9d9716b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:26.306444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1121f60b-0682-472f-ad5b-dc62b9d9716b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:26.315854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:26.317092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.317902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.318404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.319533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:26.321724 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:26.349897 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 485/961] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:26 2022] POST /identity/v3/endpoints => generated 349 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:26.393676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 477/962] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:26.418753 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:26.492869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:26.534963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d882ee-d5de-41b3-bb83-55725b440a67 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:26.569798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:26.570484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.570769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.571043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.571692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:26.573440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:26.576042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING keystone.server.flask.common [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 08 01:04:26.589978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.sql.core [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 01:04:26.589978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 01:04:26.589978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [parameters: {'user_id': '0e709e7d36724b1e970234391aca074a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 01:04:26.589978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80319) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-eb40dbb1-19de-4852-8b2c-8771b21b1191 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Aug 08 01:04:26.597554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 01:04:26.598869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application yield resource Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application next(self.gen) Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.rollback() Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.force_reraise() Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise self.value Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application session.commit() Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 08 01:04:26.600392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._prepare_impl() Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.session.flush() Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._flush(objects) Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application compat.raise_( Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application flush_context.execute() Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rec.execute(self) Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 08 01:04:26.601303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 08 01:04:26.602232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result = self._query(query) Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application conn.query(q) Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application result.read() Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 08 01:04:26.603078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [parameters: {'user_id': '0e709e7d36724b1e970234391aca074a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:26.605426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 08 01:04:26.607337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 08 01:04:26.609450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 08 01:04:26.609450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 08 01:04:26.609450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 08 01:04:26.609450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 08 01:04:26.609450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 08 01:04:26.609450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:26.609450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 486/963] 10.222.0.39 () {60 vars in 1131 bytes} [Mon Aug 8 01:04:26 2022] POST /identity/v3/users => generated 160 bytes in 181 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:26.610405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121f60b-0682-472f-ad5b-dc62b9d9716b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:26.718215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1121f60b-0682-472f-ad5b-dc62b9d9716b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:26.720234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:26.756802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:26.757803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.758347 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.758880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.768492 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:26.770395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:26.771788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932138-6c1f-43bd-82c9-7202f217c8d1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.772064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932138-6c1f-43bd-82c9-7202f217c8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.772343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0932138-6c1f-43bd-82c9-7202f217c8d1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.781080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 487/964] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:26.782370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779a9e4-da77-47de-884d-86c3614fc948 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.782657 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779a9e4-da77-47de-884d-86c3614fc948 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.782935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779a9e4-da77-47de-884d-86c3614fc948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:26.785238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:26.786210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 08 01:04:26.787205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:26.789840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 478/965] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:26.799051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:26.802723 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1779a9e4-da77-47de-884d-86c3614fc948 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:26.804245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1779a9e4-da77-47de-884d-86c3614fc948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:26.882377 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 488/966] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:26.899256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779a9e4-da77-47de-884d-86c3614fc948 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:26.908168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954efe65-5973-4a3a-aa82-c67b9d40648b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:26.945563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:26.946298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:26.946576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:26.946843 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:26.947734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:26.948029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:26.949603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:26.956173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:26.998411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 479/967] 10.222.0.39 () {56 vars in 1101 bytes} [Mon Aug 8 01:04:26 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:27.003975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779a9e4-da77-47de-884d-86c3614fc948 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:27.043583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fafa6c4-a80e-4eef-a95c-2b253d645dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:27.044250 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafa6c4-a80e-4eef-a95c-2b253d645dde None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.044527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafa6c4-a80e-4eef-a95c-2b253d645dde None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.044798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fafa6c4-a80e-4eef-a95c-2b253d645dde None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.057687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fafa6c4-a80e-4eef-a95c-2b253d645dde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-3fafa6c4-a80e-4eef-a95c-2b253d645dde None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:27.062970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:27.063985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:27.065364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 489/968] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Aug 8 01:04:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:27.070836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:27.094505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:27.104631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abdda-aa74-4f1f-bd90-382fcd67dbe1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.105248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abdda-aa74-4f1f-bd90-382fcd67dbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.105726 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287abdda-aa74-4f1f-bd90-382fcd67dbe1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.108771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 490/969] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:27.113481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ab92-ce60-4cf1-b19d-391f6752eaab None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.113832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ab92-ce60-4cf1-b19d-391f6752eaab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.114209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba2ab92-ce60-4cf1-b19d-391f6752eaab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.137553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fba2ab92-ce60-4cf1-b19d-391f6752eaab None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:27.139031 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fba2ab92-ce60-4cf1-b19d-391f6752eaab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:27.207911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a925be-6feb-4b12-8675-8fd5bfbc0146 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:27.226954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 491/970] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:27.246365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:27.247404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.247404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.247786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.248518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:27.248759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:27.248935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2ab92-ce60-4cf1-b19d-391f6752eaab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:27.250137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:27.260698 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 480/971] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Aug 8 01:04:27 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:27.267548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:27.303666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:27.361710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:27.364177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba2ab92-ce60-4cf1-b19d-391f6752eaab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:27.380396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f518381-173a-4a6c-b985-038a208b0968 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:27.399335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:27.399941 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.400218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.400603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.401362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:27.402921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:27.414602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:27.415257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.415555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.415830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.420854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 492/972] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:27 2022] POST /identity/v3/services => generated 242 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:27.431830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:27.433664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:27.450669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:27.451743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:27.452679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:27.452679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:27.452679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:27.452679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 481/973] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:27.457834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:27.572615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:27.580525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caec1128-1a51-4eae-9002-f736855edd05 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:27.618887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:27.619596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.620408 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.620691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.621346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:27.621642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:27.623080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:27.635517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 493/974] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:27.641725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:27.741449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a14aea-2da8-40f8-b002-c47a26ea1659 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:27.775297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:27.775997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.776310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.776724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.778711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:27.786076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:27.787534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:27.798899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:27.799876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 08 01:04:27.800835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:27.804625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 482/975] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:04:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:27.805826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:27.907668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5a81fd-8af0-4953-a573-f920ffaa87f2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:27.945161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:27.946192 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:27.946670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:27.947137 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:27.948098 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:27.948599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:27.950248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:27.968772 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 494/976] 10.222.0.39 () {56 vars in 1149 bytes} [Mon Aug 8 01:04:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:27.974478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.078177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad0c24-da2a-4bbb-81c9-0cba70b0340e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.112663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686977ef-c71a-4e55-96fd-2a3dd2b57018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.113277 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686977ef-c71a-4e55-96fd-2a3dd2b57018 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.113556 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686977ef-c71a-4e55-96fd-2a3dd2b57018 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.113828 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686977ef-c71a-4e55-96fd-2a3dd2b57018 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.185116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:28.193867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686977ef-c71a-4e55-96fd-2a3dd2b57018 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.195804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686977ef-c71a-4e55-96fd-2a3dd2b57018 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.298241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 483/977] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:27 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:04:28.301185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.320798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:28.386130 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003d1b-55c8-4f69-9f1b-b943b9279888 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.386451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003d1b-55c8-4f69-9f1b-b943b9279888 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.386901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc003d1b-55c8-4f69-9f1b-b943b9279888 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.388590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 484/978] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:28.393549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359386b5-77a7-462d-b0c5-ba40b6c7a0eb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.393837 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359386b5-77a7-462d-b0c5-ba40b6c7a0eb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.394137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359386b5-77a7-462d-b0c5-ba40b6c7a0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.409104 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d0deea-a8b2-4b3b-99e0-6ebba2d39ea9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.412047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-359386b5-77a7-462d-b0c5-ba40b6c7a0eb None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:28.413241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-359386b5-77a7-462d-b0c5-ba40b6c7a0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:28.446951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.447508 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.447963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.448238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.459095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.460899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:28.476533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:28.477517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:28.478471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:28.478471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:28.478471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:28.478471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 495/979] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:28.483393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.488057 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 485/980] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:28 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:28.510661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359386b5-77a7-462d-b0c5-ba40b6c7a0eb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.539942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:28.555975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:28.592403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac2eb78-ec45-4c2b-8e83-93ac9c625dfe None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.621015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359386b5-77a7-462d-b0c5-ba40b6c7a0eb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.627294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.628077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.628286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.628434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.629078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:28.629383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.630825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.643795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 496/981] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:28.648953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.657794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.658469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.658748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.659020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.659622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.660995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:28.669930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:28.670964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:28.671789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:28.676455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 486/982] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:28.676876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.753766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb0982b-1aa6-456c-bf0a-6eb7851c53bd None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.778000 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:28.786712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:28.793064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.793502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2dbb1f4-7952-4771-99ac-87c8ebab671b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.794012 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.794671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.794945 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.802758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.804544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:28.816019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:28.816914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:28.817812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 497/983] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:28.822975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.832058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.832655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.832927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.833194 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.833819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:28.834144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.835533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.840348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 487/984] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:28.846028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:28.939321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33df280b-25b9-4fe3-bcae-5f5738c06fa4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.953697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f77fe40-8b27-42fc-b62b-0efb9bfb5aae None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:28.974744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.975339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.975615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.975877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.976555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:28.976850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.978312 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.988471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:28.989093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:28.989374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:28.989648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:28.990308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:28.990614 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:28.996286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 498/985] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:28.996427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:28.997351 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:29.000961 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 488/986] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:29.006750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:29.025516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:29.052419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:29.107081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedf1d37-a7f1-475c-84d4-44ac2689cb5a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:29.122939 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a8194e-3e26-4bc2-b335-041db97158fc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:29.144447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:29.145051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:29.145328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:29.145591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:29.146339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] RBAC: Adding query filter params (role.id=3a0564cda74d4c538041631392b37a8f, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=091efb05bd0b47fd87d3641bf7354284) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:29.146638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:29.148054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:29.154079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 499/987] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:28 2022] GET /identity/v3/role_assignments?user.id=091efb05bd0b47fd87d3641bf7354284&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=3a0564cda74d4c538041631392b37a8f => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:29.175029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1779d1e7-8b8c-41cd-94ab-c870155ec978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:29.175667 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d1e7-8b8c-41cd-94ab-c870155ec978 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:29.175948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d1e7-8b8c-41cd-94ab-c870155ec978 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:29.176221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1779d1e7-8b8c-41cd-94ab-c870155ec978 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:29.176961 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779d1e7-8b8c-41cd-94ab-c870155ec978 None admin] RBAC: Adding query filter params (interface=admin, service_id=127c060644e64903aaaa772aaaba42e9, region_id=RegionOne) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:29.177267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779d1e7-8b8c-41cd-94ab-c870155ec978 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:29.178713 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1779d1e7-8b8c-41cd-94ab-c870155ec978 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:29.185902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 489/988] 10.222.0.39 () {56 vars in 1249 bytes} [Mon Aug 8 01:04:29 2022] GET /identity/v3/endpoints?service_id=127c060644e64903aaaa772aaaba42e9&interface=admin®ion_id=RegionOne => generated 193 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:29.191826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:29.300769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9440a9-2eec-4bf3-a412-014277b057e5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:29.316342 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:29.341890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897d1fc9-07e0-469c-972a-4d7a4528b421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:29.342583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1fc9-07e0-469c-972a-4d7a4528b421 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:29.342857 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1fc9-07e0-469c-972a-4d7a4528b421 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:29.343129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897d1fc9-07e0-469c-972a-4d7a4528b421 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:29.343731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d1fc9-07e0-469c-972a-4d7a4528b421 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:29.345133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897d1fc9-07e0-469c-972a-4d7a4528b421 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:29.352315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 500/989] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:29 2022] GET /identity/v3/services => generated 1727 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:04:29.484786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2a60a-b61d-4119-97fd-80211af4cbd5 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:29.485081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2a60a-b61d-4119-97fd-80211af4cbd5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:29.485325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d2a60a-b61d-4119-97fd-80211af4cbd5 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:29.486953 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 490/990] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:29.492659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cfd94-0c97-4d06-b2dc-3f5f9a2d8020 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:29.492982 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cfd94-0c97-4d06-b2dc-3f5f9a2d8020 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:29.493184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06cfd94-0c97-4d06-b2dc-3f5f9a2d8020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:29.512797 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a06cfd94-0c97-4d06-b2dc-3f5f9a2d8020 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:29.513992 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a06cfd94-0c97-4d06-b2dc-3f5f9a2d8020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:29.585112 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 501/991] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:29 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:29.607357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2a60a-b61d-4119-97fd-80211af4cbd5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:29.693772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:29.716123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d2a60a-b61d-4119-97fd-80211af4cbd5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:29.750433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:29.751057 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:29.751331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:29.751596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] PATH_INFO: `/v3/services/compute` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:29.752227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:29.753583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:29.762906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:29.763931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:29.764799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:29.766373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 491/992] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:29.770393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cfd94-0c97-4d06-b2dc-3f5f9a2d8020 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:29.876687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06cfd94-0c97-4d06-b2dc-3f5f9a2d8020 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:29.886328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:29.912521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:29.913135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:29.913413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:29.913684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:29.914345 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:29.914649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:29.916036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:29.925492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 502/993] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:29.926662 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:30.028458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e656ea8-abfd-4419-a6a5-d765ce4b9fdf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:30.064405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:30.065023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:30.065293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:30.065564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:30.066222 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:30.066524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:30.067884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:30.073022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 492/994] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:29 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:30.078979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:30.194151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4ec204-bf74-4c22-acc1-d342ebcaf1fb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:30.230196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6a4930-685b-433b-87a0-3f05cf59f696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:30.230812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4930-685b-433b-87a0-3f05cf59f696 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:30.231066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4930-685b-433b-87a0-3f05cf59f696 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:30.231359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6a4930-685b-433b-87a0-3f05cf59f696 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:30.232047 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4930-685b-433b-87a0-3f05cf59f696 None admin] RBAC: Adding query filter params (interface=public, service_id=cfc03f96a9584bafbb4ce8b79ea08363, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:30.232338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4930-685b-433b-87a0-3f05cf59f696 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:30.233731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6a4930-685b-433b-87a0-3f05cf59f696 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:30.239217 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 503/995] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:04:30 2022] GET /identity/v3/endpoints?service_id=cfc03f96a9584bafbb4ce8b79ea08363&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:30.244631 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:30.255557 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:30.346504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d770a2d3-b6e2-4dce-84fe-4096228a6c3a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:30.382806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd259e9b-c602-48f1-a824-56f330a4b541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:30.383499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259e9b-c602-48f1-a824-56f330a4b541 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:30.383769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259e9b-c602-48f1-a824-56f330a4b541 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:30.384025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd259e9b-c602-48f1-a824-56f330a4b541 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:30.384705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259e9b-c602-48f1-a824-56f330a4b541 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:30.386288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd259e9b-c602-48f1-a824-56f330a4b541 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:30.398472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 493/996] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:30 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:04:31.176387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdba11-a215-4c64-9971-0fc3caac52ca None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.176928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdba11-a215-4c64-9971-0fc3caac52ca None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.176928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdba11-a215-4c64-9971-0fc3caac52ca None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.178254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 504/997] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:31.183731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c608f-8463-42ce-9baa-80e8f245874f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.184148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c608f-8463-42ce-9baa-80e8f245874f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.184224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39c608f-8463-42ce-9baa-80e8f245874f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.202996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e39c608f-8463-42ce-9baa-80e8f245874f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:31.204158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e39c608f-8463-42ce-9baa-80e8f245874f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:31.274678 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 494/998] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:31.296812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdba11-a215-4c64-9971-0fc3caac52ca None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:31.335451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:31.384788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad319b2-4b80-4cc0-8b45-84db1865cc96 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.385097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad319b2-4b80-4cc0-8b45-84db1865cc96 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.385421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad319b2-4b80-4cc0-8b45-84db1865cc96 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.386813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 495/999] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:31.391916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e01d-8d80-45e7-ad3a-2aa41e5258dc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.392205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e01d-8d80-45e7-ad3a-2aa41e5258dc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.392480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e01d-8d80-45e7-ad3a-2aa41e5258dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.399120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:31.404496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdba11-a215-4c64-9971-0fc3caac52ca None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:31.412395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-48d9e01d-8d80-45e7-ad3a-2aa41e5258dc None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:31.413596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-48d9e01d-8d80-45e7-ad3a-2aa41e5258dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:31.441991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:31.442648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.442998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.443253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] PATH_INFO: `/v3/services/image` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.443830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:31.445204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:31.453682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:31.454918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:31.455934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 505/1000] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Aug 8 01:04:31 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:31.460523 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:31.498108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 496/1001] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:31 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:31.514728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e01d-8d80-45e7-ad3a-2aa41e5258dc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:31.569524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:31.573281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d6de5a-c5ad-4056-875f-6fce6fae2e09 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:31.609654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:31.610286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.610559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.610823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.611444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:31.611734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:31.613101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:31.618658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 506/1002] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:31 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:31.624890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:31.627857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e01d-8d80-45e7-ad3a-2aa41e5258dc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:31.663365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:31.669866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:31.670533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.670810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.671085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.671669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:31.673047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:31.684485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:31.685622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:31.691861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 497/1003] 10.222.0.39 () {56 vars in 1126 bytes} [Mon Aug 8 01:04:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:31.692672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:31.737546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef558bd1-14d7-4de7-8f30-29c2dc96d0f5 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:31.775487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:31.776163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.776641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.776921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.777555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] RBAC: Adding query filter params (type=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:31.777864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:31.779294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:31.784314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 507/1004] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:31 2022] GET /identity/v3/services?type=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:31.814815 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03a8fcdc-dce9-463c-9639-153cdf722b51 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:31.853250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:31.854381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:31.854862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:31.855326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:31.856204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:31.856710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:31.858349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:31.864565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 498/1005] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:31 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:31.870281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:31.903431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:31.983407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2938dd94-d997-4fa4-8dfe-0eedbfc5cd12 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:32.020296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb01378-221f-49f7-abde-6c42b6ba4382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:32.021222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb01378-221f-49f7-abde-6c42b6ba4382 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:32.021680 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb01378-221f-49f7-abde-6c42b6ba4382 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:32.022261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb01378-221f-49f7-abde-6c42b6ba4382 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:32.023133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb01378-221f-49f7-abde-6c42b6ba4382 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:32.023616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb01378-221f-49f7-abde-6c42b6ba4382 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:32.025370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb01378-221f-49f7-abde-6c42b6ba4382 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:32.031438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 508/1006] 10.222.0.39 () {56 vars in 1122 bytes} [Mon Aug 8 01:04:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:32.037412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:32.099836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:32.145198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3dd3c4-524f-4b44-8e55-12a56284209b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:32.178698 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10309b8-d540-4137-8cd4-2884246eb494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:32.179295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10309b8-d540-4137-8cd4-2884246eb494 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:32.179579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10309b8-d540-4137-8cd4-2884246eb494 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:32.179795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10309b8-d540-4137-8cd4-2884246eb494 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:32.180484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10309b8-d540-4137-8cd4-2884246eb494 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:32.181896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10309b8-d540-4137-8cd4-2884246eb494 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:32.201748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 499/1007] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:32 2022] POST /identity/v3/endpoints => generated 325 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:32.391230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3f703-b73c-4634-b45c-c4628a1a56cd None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:32.391745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3f703-b73c-4634-b45c-c4628a1a56cd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:32.391745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e3f703-b73c-4634-b45c-c4628a1a56cd None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:32.393227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 509/1008] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:32.398625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3cc5-049e-4b44-8fa5-7fb096d9a81e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:32.398909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3cc5-049e-4b44-8fa5-7fb096d9a81e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:32.399160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0f3cc5-049e-4b44-8fa5-7fb096d9a81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:32.423445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7d0f3cc5-049e-4b44-8fa5-7fb096d9a81e None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:32.424656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7d0f3cc5-049e-4b44-8fa5-7fb096d9a81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:32.500241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 500/1009] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:32 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:32.522776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3f703-b73c-4634-b45c-c4628a1a56cd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:32.617335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:32.628434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e3f703-b73c-4634-b45c-c4628a1a56cd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:32.662303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:32.662851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:32.663128 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:32.663398 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:32.663980 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:32.665365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:32.674354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:32.675364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 08 01:04:32.676315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:32.680623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 510/1010] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:32.682107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f3cc5-049e-4b44-8fa5-7fb096d9a81e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:32.728661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:32.785865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0f3cc5-049e-4b44-8fa5-7fb096d9a81e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:32.821506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:32.822133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:32.822489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:32.822827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:32.823512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] RBAC: Adding query filter params (name=compute) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:32.823818 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:32.825266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:32.834962 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 501/1011] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:32.836663 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:32.945839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b27a397-c373-40e9-b948-3a165f0cca97 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:32.980540 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1878156f-bb81-4da0-9fe9-b424af4e0374 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:32.981145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878156f-bb81-4da0-9fe9-b424af4e0374 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:32.981424 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878156f-bb81-4da0-9fe9-b424af4e0374 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:32.981693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1878156f-bb81-4da0-9fe9-b424af4e0374 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:32.982350 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878156f-bb81-4da0-9fe9-b424af4e0374 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:32.982655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878156f-bb81-4da0-9fe9-b424af4e0374 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:32.984038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1878156f-bb81-4da0-9fe9-b424af4e0374 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:32.993806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 511/1012] 10.222.0.39 () {56 vars in 1112 bytes} [Mon Aug 8 01:04:32 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:32.995433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:33.098284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7daf3f-ce02-42f3-8a16-a27eb7e339bf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:33.112289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:33.140489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a9955d-0c41-4336-a5dc-acc06d316860 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:33.141095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9955d-0c41-4336-a5dc-acc06d316860 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:33.141366 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9955d-0c41-4336-a5dc-acc06d316860 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:33.141637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a9955d-0c41-4336-a5dc-acc06d316860 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:33.142309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9955d-0c41-4336-a5dc-acc06d316860 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:33.143675 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a9955d-0c41-4336-a5dc-acc06d316860 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:33.164674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 502/1013] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:32 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:04:33.778831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1275a8-fd5b-4c16-9e7e-dd96934161a3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:33.779421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1275a8-fd5b-4c16-9e7e-dd96934161a3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:33.779421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1275a8-fd5b-4c16-9e7e-dd96934161a3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:33.780938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 512/1014] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:33.786261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1a993-c66b-463d-a82e-c4ee48e0a5f7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:33.786693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1a993-c66b-463d-a82e-c4ee48e0a5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:33.786871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c1a993-c66b-463d-a82e-c4ee48e0a5f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:33.805848 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-88c1a993-c66b-463d-a82e-c4ee48e0a5f7 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:33.807217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-88c1a993-c66b-463d-a82e-c4ee48e0a5f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:33.884894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 503/1015] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:33 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:33.907420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1275a8-fd5b-4c16-9e7e-dd96934161a3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:33.931691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:34.018831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1275a8-fd5b-4c16-9e7e-dd96934161a3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:34.054174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c342763a-a178-4b20-bde2-ce11ee712a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:34.054687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342763a-a178-4b20-bde2-ce11ee712a1b None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:34.055006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342763a-a178-4b20-bde2-ce11ee712a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:34.055273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c342763a-a178-4b20-bde2-ce11ee712a1b None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:34.055922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342763a-a178-4b20-bde2-ce11ee712a1b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:34.057335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c342763a-a178-4b20-bde2-ce11ee712a1b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:34.082088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 513/1016] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:33 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:34.220809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f743f6-a81d-42a5-88c1-375d19b7e7b2 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:34.221070 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f743f6-a81d-42a5-88c1-375d19b7e7b2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:34.221320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f743f6-a81d-42a5-88c1-375d19b7e7b2 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:34.222931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 504/1017] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:34.228188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d85127-d302-4fde-8686-d7db264b61d6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:34.228556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d85127-d302-4fde-8686-d7db264b61d6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:34.228867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d85127-d302-4fde-8686-d7db264b61d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:34.247719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-45d85127-d302-4fde-8686-d7db264b61d6 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:34.248844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-45d85127-d302-4fde-8686-d7db264b61d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:34.323997 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 514/1018] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:34 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:34.346550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f743f6-a81d-42a5-88c1-375d19b7e7b2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:34.445870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:34.457685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f743f6-a81d-42a5-88c1-375d19b7e7b2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:34.491203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48416b14-ae84-4a96-baa6-35854230aee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:34.491828 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416b14-ae84-4a96-baa6-35854230aee5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:34.492103 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416b14-ae84-4a96-baa6-35854230aee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:34.492369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48416b14-ae84-4a96-baa6-35854230aee5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:34.493466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416b14-ae84-4a96-baa6-35854230aee5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:34.495149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48416b14-ae84-4a96-baa6-35854230aee5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:34.496885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 505/1019] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:34.502573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d85127-d302-4fde-8686-d7db264b61d6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:34.511172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:34.610896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d85127-d302-4fde-8686-d7db264b61d6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:34.645407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39febd4-d294-4a37-a70f-ac7cfd14e178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:34.646339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39febd4-d294-4a37-a70f-ac7cfd14e178 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:34.646794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39febd4-d294-4a37-a70f-ac7cfd14e178 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:34.647261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39febd4-d294-4a37-a70f-ac7cfd14e178 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:34.648101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39febd4-d294-4a37-a70f-ac7cfd14e178 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:34.649718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39febd4-d294-4a37-a70f-ac7cfd14e178 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:34.686327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 515/1020] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:04:34 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:04:35.270202 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70387ab2-34b7-4347-9c25-e2a723d2286c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:35.270783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70387ab2-34b7-4347-9c25-e2a723d2286c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:35.270783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70387ab2-34b7-4347-9c25-e2a723d2286c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:35.272046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 506/1021] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:35.277848 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541417f7-6c96-437a-9f3f-5cc8021c269b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:35.278337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541417f7-6c96-437a-9f3f-5cc8021c269b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:35.278417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-541417f7-6c96-437a-9f3f-5cc8021c269b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:35.297374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-541417f7-6c96-437a-9f3f-5cc8021c269b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:35.298608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-541417f7-6c96-437a-9f3f-5cc8021c269b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:35.355276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:35.378170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 516/1022] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:35 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:35.394602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70387ab2-34b7-4347-9c25-e2a723d2286c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:35.505167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70387ab2-34b7-4347-9c25-e2a723d2286c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:35.539648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:35.540276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:35.540550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:35.541162 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:35.551820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:35.556536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:35.557540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:35.558806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:35.559957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 507/1023] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Aug 8 01:04:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:35.564911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541417f7-6c96-437a-9f3f-5cc8021c269b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:35.668560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-541417f7-6c96-437a-9f3f-5cc8021c269b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:35.703620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:35.704235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:35.704512 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:35.704782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:35.705446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:35.705744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:35.707161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:35.715713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 517/1024] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Aug 8 01:04:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:35.721583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:35.744883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:35.828670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888c25a3-beee-45d4-8eeb-73e9824a6e7f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:35.863666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:35.864300 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:35.864580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:35.864850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:35.875259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:35.876704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:35.891431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:35.892435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:35.893350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:35.893350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:35.893350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:35.895195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 508/1025] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:35.898617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:35.952931 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.005282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1de0fe5-6d9b-465f-8f36-72788a97b595 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.040411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248c500c-eccc-498f-9e14-5b8de06fd736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.041117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c500c-eccc-498f-9e14-5b8de06fd736 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.041395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c500c-eccc-498f-9e14-5b8de06fd736 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.041659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248c500c-eccc-498f-9e14-5b8de06fd736 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.042327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c500c-eccc-498f-9e14-5b8de06fd736 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:36.042628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c500c-eccc-498f-9e14-5b8de06fd736 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.043994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248c500c-eccc-498f-9e14-5b8de06fd736 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.056171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 518/1026] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:36.061767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.095979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457ae5-08ee-4b37-965c-e2c93dd8ede8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.096514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457ae5-08ee-4b37-965c-e2c93dd8ede8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.096792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6457ae5-08ee-4b37-965c-e2c93dd8ede8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.099206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 519/1027] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:36.104161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30cf09-4047-4caa-9f98-93ee067fbd76 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.104557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30cf09-4047-4caa-9f98-93ee067fbd76 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.104930 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c30cf09-4047-4caa-9f98-93ee067fbd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.127616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1c30cf09-4047-4caa-9f98-93ee067fbd76 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:36.128818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1c30cf09-4047-4caa-9f98-93ee067fbd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:36.145880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.177117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f1a3f2-75e8-4b88-82b1-1189ed1c24be None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.203696 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 520/1028] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:36.213674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.214511 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.214887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.215289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.223175 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.224926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.225094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30cf09-4047-4caa-9f98-93ee067fbd76 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:36.237284 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:36.238590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:36.239697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 509/1029] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:36.244699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.271410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.332714 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c30cf09-4047-4caa-9f98-93ee067fbd76 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.355644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602d7662-f095-4bf0-884c-d03f602a4164 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.368977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.369614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.369886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.370190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] PATH_INFO: `/v3/services/image` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.370767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.372146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:36.380942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:36.382030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:36.382928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:36.387317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 521/1030] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:36.388097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.390159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.397036 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.398120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.398427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.398707 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.399813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:36.400155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.401925 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.421282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 510/1031] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:36.427263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.512952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc4e2c-4087-4963-b9ca-8ce523651be6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.516537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.534226 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978fcb33-93ba-44c7-be4f-293f74813d70 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.551354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.551969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.552253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.552523 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.553154 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:36.553454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.554983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.560728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 522/1032] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/services?name=image => generated 122 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:36.566760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.569090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4773f38-4f0d-40d6-9ab8-1912cc5b8acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.569687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773f38-4f0d-40d6-9ab8-1912cc5b8acd None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.569973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773f38-4f0d-40d6-9ab8-1912cc5b8acd None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.570401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4773f38-4f0d-40d6-9ab8-1912cc5b8acd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.628254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.641487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4773f38-4f0d-40d6-9ab8-1912cc5b8acd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.642986 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4773f38-4f0d-40d6-9ab8-1912cc5b8acd None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.673650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5df8e2e-c993-4549-b494-5d5fc6f7cbc3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.709065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e0cffc-9c43-4cc9-ac80-0d00fd202206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.709676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0cffc-9c43-4cc9-ac80-0d00fd202206 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.709955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0cffc-9c43-4cc9-ac80-0d00fd202206 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.710253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e0cffc-9c43-4cc9-ac80-0d00fd202206 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.710889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0cffc-9c43-4cc9-ac80-0d00fd202206 None admin] RBAC: Adding query filter params (type=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:36.711194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0cffc-9c43-4cc9-ac80-0d00fd202206 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.712593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e0cffc-9c43-4cc9-ac80-0d00fd202206 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.722468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 523/1033] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:36.722468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143809bc-44db-4cf4-a7e8-3b68068d9e2e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.722468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143809bc-44db-4cf4-a7e8-3b68068d9e2e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.722468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143809bc-44db-4cf4-a7e8-3b68068d9e2e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.722468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 524/1034] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:36.723368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143809bc-44db-4cf4-a7e8-3b68068d9e2e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.748889 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 511/1035] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:04:36.750285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099f3b1-40c1-4509-8907-1e10fc252d06 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.750580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099f3b1-40c1-4509-8907-1e10fc252d06 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.750854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5099f3b1-40c1-4509-8907-1e10fc252d06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.754855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.768205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5099f3b1-40c1-4509-8907-1e10fc252d06 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:36.769324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5099f3b1-40c1-4509-8907-1e10fc252d06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:36.828034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143809bc-44db-4cf4-a7e8-3b68068d9e2e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.835042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 512/1036] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:36 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:36.835869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099f3b1-40c1-4509-8907-1e10fc252d06 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.856283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.865849 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.866495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.866774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.867044 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.867806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] RBAC: Adding query filter params (interface=public, service_id=15987fc495874bc380dba0b39a9c6ee9, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:36.868143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.869601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.879095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 525/1037] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/endpoints?service_id=15987fc495874bc380dba0b39a9c6ee9&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:36.879095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:36.933919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5099f3b1-40c1-4509-8907-1e10fc252d06 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.966943 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:36.967583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:36.967838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:36.968103 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:36.973062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:36.977872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:36.979408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:36.980605 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7c7ff-c9c5-4dec-980c-faf9c16306b6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:36.993325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:36.994573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:36.995479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:36.995479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:36.995479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:36.995479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 513/1038] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:36.995479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:37.021529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:37.022120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:37.022399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:37.022670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:37.023816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:37.025306 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:37.027000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 526/1039] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:37.027765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:37.068422 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:37.098416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f605e9cc-d2d0-429c-9e6b-b92cceb4a2d0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:37.127267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b713e-ee9a-4074-b23c-afdf673917ba None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:37.138293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:37.138908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:37.139183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:37.139452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:37.140062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:37.141460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:37.148182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 514/1040] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:04:36 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:04:37.151238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:37.162073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:37.162714 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:37.162988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:37.163254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:37.163928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:37.164227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:37.165651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:37.179974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 527/1041] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:37.186157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:37.215357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:37.281798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04df9e8-091b-45e6-ba8e-d5454601a04b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:37.307295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aabab1-2313-4ed9-b1f1-5ff4869d2959 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:37.330304 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:37.331009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:37.331285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:37.331552 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:37.332197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:37.334349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:37.345737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:37.352309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:37.356130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:37.356130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:37.356130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:37.363280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:37.366093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 515/1042] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:04:37 2022] POST /identity/v3/users => generated 285 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:37.366530 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:37.377641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:37.378759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:37.379698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:37.384283 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 528/1043] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:37.385847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:37.508248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbd7476-f253-4e97-9947-6eeda40bddcf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:37.546603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bac038-6916-479a-a08d-2c9c6f5b719a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:37.547564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bac038-6916-479a-a08d-2c9c6f5b719a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:37.547911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bac038-6916-479a-a08d-2c9c6f5b719a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:37.548194 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bac038-6916-479a-a08d-2c9c6f5b719a None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:37.548899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bac038-6916-479a-a08d-2c9c6f5b719a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:37.549204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bac038-6916-479a-a08d-2c9c6f5b719a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:37.550682 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bac038-6916-479a-a08d-2c9c6f5b719a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:37.568701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 516/1044] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:37.570226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:37.684300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:37.699886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fb14dd-a03d-4e99-a983-fdac086ce5ef None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:37.734981 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11779272-510d-47eb-bbeb-5b4ee4abe145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:37.735594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779272-510d-47eb-bbeb-5b4ee4abe145 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:37.735874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779272-510d-47eb-bbeb-5b4ee4abe145 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:37.736147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11779272-510d-47eb-bbeb-5b4ee4abe145 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:37.736886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11779272-510d-47eb-bbeb-5b4ee4abe145 None admin] RBAC: Adding query filter params (role.id=3a0564cda74d4c538041631392b37a8f, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4a0d809789674bdeaa6763ee4151ca86) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:37.737194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11779272-510d-47eb-bbeb-5b4ee4abe145 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:37.738671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11779272-510d-47eb-bbeb-5b4ee4abe145 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:37.744698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 529/1045] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:37 2022] GET /identity/v3/role_assignments?user.id=4a0d809789674bdeaa6763ee4151ca86&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=3a0564cda74d4c538041631392b37a8f => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:39.168011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ca2a-389d-4ca2-8235-2d63edf40abc None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.168554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ca2a-389d-4ca2-8235-2d63edf40abc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.168554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec5ca2a-389d-4ca2-8235-2d63edf40abc None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.170099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 517/1046] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:39.175216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3935cf-0a52-44f9-974d-d8613297f27c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.175640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3935cf-0a52-44f9-974d-d8613297f27c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.175814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3935cf-0a52-44f9-974d-d8613297f27c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.194885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ed3935cf-0a52-44f9-974d-d8613297f27c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:39.196066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ed3935cf-0a52-44f9-974d-d8613297f27c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:39.264729 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 530/1047] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:39.286909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ca2a-389d-4ca2-8235-2d63edf40abc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:39.343927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:39.395133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec5ca2a-389d-4ca2-8235-2d63edf40abc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:39.430022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348ab85f-9c0a-4e7b-bb1e-f32e4b79da89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:39.430806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab85f-9c0a-4e7b-bb1e-f32e4b79da89 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.431084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab85f-9c0a-4e7b-bb1e-f32e4b79da89 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.431398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348ab85f-9c0a-4e7b-bb1e-f32e4b79da89 None admin] PATH_INFO: `/v3/services/image` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.431977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ab85f-9c0a-4e7b-bb1e-f32e4b79da89 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:39.433329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348ab85f-9c0a-4e7b-bb1e-f32e4b79da89 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-348ab85f-9c0a-4e7b-bb1e-f32e4b79da89 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:39.442520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:39.443509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 08 01:04:39.444390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:39.446455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 518/1048] 10.222.0.39 () {56 vars in 1105 bytes} [Mon Aug 8 01:04:39 2022] GET /identity/v3/services/image => generated 86 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:39.449824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3935cf-0a52-44f9-974d-d8613297f27c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:39.466482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79f4d4-27cf-49af-b63d-2c0c143f9ad8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.466925 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79f4d4-27cf-49af-b63d-2c0c143f9ad8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.467336 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb79f4d4-27cf-49af-b63d-2c0c143f9ad8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.468951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 519/1049] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:04:39.473777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbfe21-c1b2-4824-a720-624ad3227f49 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.474067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbfe21-c1b2-4824-a720-624ad3227f49 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.474343 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bbfe21-c1b2-4824-a720-624ad3227f49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.492011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c1bbfe21-c1b2-4824-a720-624ad3227f49 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:39.493196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c1bbfe21-c1b2-4824-a720-624ad3227f49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:39.536253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:39.560109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3935cf-0a52-44f9-974d-d8613297f27c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:39.567727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 520/1050] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:39.591208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbfe21-c1b2-4824-a720-624ad3227f49 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:39.596826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:39.597441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.597713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.597978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.598649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] RBAC: Adding query filter params (name=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:39.599349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:39.600750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:39.606986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 531/1051] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:39.612374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:39.642380 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:39.700305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1bbfe21-c1b2-4824-a720-624ad3227f49 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:39.709681 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b080d60b-89e5-4117-adaf-059acb5f3d99 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:39.736799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67658cb9-519d-41ff-b274-8961e9b91bec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:39.737442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67658cb9-519d-41ff-b274-8961e9b91bec None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.737717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67658cb9-519d-41ff-b274-8961e9b91bec None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.737993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67658cb9-519d-41ff-b274-8961e9b91bec None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.742868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a147ee-17ba-4853-87f1-4866588f15f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:39.743471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a147ee-17ba-4853-87f1-4866588f15f1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.743773 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a147ee-17ba-4853-87f1-4866588f15f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.744069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a147ee-17ba-4853-87f1-4866588f15f1 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.744685 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a147ee-17ba-4853-87f1-4866588f15f1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:39.744979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a147ee-17ba-4853-87f1-4866588f15f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:39.746372 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a147ee-17ba-4853-87f1-4866588f15f1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:39.748593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67658cb9-519d-41ff-b274-8961e9b91bec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:39.751276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 532/1052] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:39 2022] GET /identity/v3/services?type=image => generated 350 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:39.752470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec0051-388a-4d59-9cb7-f7af113f9b6f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.752749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec0051-388a-4d59-9cb7-f7af113f9b6f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.753013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ec0051-388a-4d59-9cb7-f7af113f9b6f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-67658cb9-519d-41ff-b274-8961e9b91bec None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:39.753231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:39.754186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:39.755049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:39.755707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 533/1053] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:39 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:39.755777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 521/1054] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:39.760569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec0051-388a-4d59-9cb7-f7af113f9b6f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:39.761292 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbce5e-adf9-4d15-a44e-e3137f8c8d59 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.761573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbce5e-adf9-4d15-a44e-e3137f8c8d59 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.761843 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecbce5e-adf9-4d15-a44e-e3137f8c8d59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.769851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:39.780564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6ecbce5e-adf9-4d15-a44e-e3137f8c8d59 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:39.781788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6ecbce5e-adf9-4d15-a44e-e3137f8c8d59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:39.849340 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 522/1055] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:39 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:39.850356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbce5e-adf9-4d15-a44e-e3137f8c8d59 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:39.866080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ec0051-388a-4d59-9cb7-f7af113f9b6f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:39.887824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:39.900897 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:39.901533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.901808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.902097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.902763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:39.903062 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:39.904426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:39.912319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 534/1056] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:39.913081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:39.952926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecbce5e-adf9-4d15-a44e-e3137f8c8d59 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:39.978007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:39.986785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:39.987418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:39.987686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:39.987952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:39.988591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:39.989960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.011314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 523/1057] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:04:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:40.011730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f76710-d528-46e0-b0fe-114d6fe58efb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.012401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.056634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.057278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.057555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.057822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.070630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:40.075690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:40.076879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:40.077922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 535/1058] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Aug 8 01:04:39 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:40.085239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.140143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:40.151916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bc6b5f-6df1-475d-8a88-0e8d240471fb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.191830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.192529 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.192774 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.193050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] PATH_INFO: `/v3/users/b24aa727aa4d4d5ca1ccd5c8c4b30187` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.211485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] RBAC: Authorizing `identity:get_user(user_id=b24aa727aa4d4d5ca1ccd5c8c4b30187)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.213060 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.213185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe9348d-bc35-46f0-84e7-e3e3c2f7c627 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.215861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 524/1059] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/users/b24aa727aa4d4d5ca1ccd5c8c4b30187 => generated 285 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:40.221832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.243367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:40.254487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.255104 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.255382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.255654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.256322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:40.256630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.258003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.267965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 536/1060] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:40.273820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.329540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff846675-0b86-462c-9e44-2334f4f080ea None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.364901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.365514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.365795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.366086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.383561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9fb1d5a-34d9-47b5-9117-0ca94644c49b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.386152 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:40.422811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.423442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.423761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.423966 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.434169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.435619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.439795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.441228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:40.450593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:40.451578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:40.457628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:40.457628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:40.457628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:40.457628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 537/1061] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:40.458041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.502011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:40.563222 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 525/1062] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:04:40.566324 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9210e6c-04b5-4614-b000-38c3439f703f None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.569768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.601562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.602200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.602474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.602741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.603401 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:40.603696 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.605196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.616522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 538/1063] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:40.622145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.628987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:40.678768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0b4f4f-4c77-4fb5-871c-734559e59eb6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.715035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.715673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.716231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.716231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.717490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] RBAC: Authorizing `identity:get_project(project_id=b3d12619bda849c1be58787795d00b9b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.718922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.720736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 526/1064] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/projects/b3d12619bda849c1be58787795d00b9b => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:40.726409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:40.726755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.730687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4814ea11-2bd2-40ab-8134-6e0cb4b2a41c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.773955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.774629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.774934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.775476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.783808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.785511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:40.798258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:40.799260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:40.800213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 539/1065] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:04:40.805124 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:40.834896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b557a7-19b6-4c17-90f8-c7faaed964ed None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.852375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:40.870781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.871384 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.871657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.871927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.872640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=b3d12619bda849c1be58787795d00b9b, user.id=b24aa727aa4d4d5ca1ccd5c8c4b30187) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:40.872941 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.874394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.879811 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 527/1066] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/role_assignments?user.id=b24aa727aa4d4d5ca1ccd5c8c4b30187&scope.project.id=b3d12619bda849c1be58787795d00b9b&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:40.928132 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a260b724-3a08-4c11-9c4f-869e82189388 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:40.967443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:40.968068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:40.968347 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:40.968626 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:40.969382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:40.969687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:40.971195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:40.991534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 540/1067] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:40.997357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:41.108483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766a2cff-452e-43f2-b885-ba17704a15bf None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:41.149393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:41.150034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:41.150482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:41.150892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:41.162002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:41.163456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:41.177508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:41.178530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:41.179442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:41.179442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:41.179442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:41.179442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 528/1068] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:41.185976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:41.206603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:41.293737 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ca9559-dea5-409f-80d0-940104529e11 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:41.328443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:41.329051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:41.329320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:41.329650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:41.330316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:41.330633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:41.332016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:41.345497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 541/1069] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:41.351110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:41.387753 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:41.456549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3e6856-135a-463c-8f98-8383c0c502ba None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:41.491227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:41.492022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:41.492399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:41.492757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:41.499804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:41.501454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:41.513416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:41.514591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:41.515714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:41.521569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 529/1070] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:41.522835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:41.602020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:41.626446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a452e6-c5d4-499f-a148-fa6bb2e1ded9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:41.661526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb5942c-3046-4972-a42a-c86cba885972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:41.662276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5942c-3046-4972-a42a-c86cba885972 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:41.662654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5942c-3046-4972-a42a-c86cba885972 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:41.663010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb5942c-3046-4972-a42a-c86cba885972 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:41.663792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5942c-3046-4972-a42a-c86cba885972 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:41.664183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5942c-3046-4972-a42a-c86cba885972 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:41.665769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb5942c-3046-4972-a42a-c86cba885972 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:41.683177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 542/1071] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:41.684554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:41.780693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:41.788754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350b38f4-6596-484e-95c7-970d30cd0709 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:41.823761 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8264a211-8ae1-4a4a-8fad-76624bd03919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:41.824563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a211-8ae1-4a4a-8fad-76624bd03919 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:41.824933 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a211-8ae1-4a4a-8fad-76624bd03919 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:41.825356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8264a211-8ae1-4a4a-8fad-76624bd03919 None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4a0d809789674bdeaa6763ee4151ca86/roles/3a0564cda74d4c538041631392b37a8f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:41.827622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a211-8ae1-4a4a-8fad-76624bd03919 None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=4a0d809789674bdeaa6763ee4151ca86, role_id=3a0564cda74d4c538041631392b37a8f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:41.829143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8264a211-8ae1-4a4a-8fad-76624bd03919 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:41.845267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 530/1072] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:04:41 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/4a0d809789674bdeaa6763ee4151ca86/roles/3a0564cda74d4c538041631392b37a8f => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:04:42.060267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8200cd-38e7-4591-adbb-e286fecfd3a1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:42.060579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8200cd-38e7-4591-adbb-e286fecfd3a1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:42.060850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8200cd-38e7-4591-adbb-e286fecfd3a1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:42.062606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 543/1073] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:42.067813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf598b9-14a7-4ce1-9dfc-0fc4f561655c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:42.068101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf598b9-14a7-4ce1-9dfc-0fc4f561655c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:42.068377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf598b9-14a7-4ce1-9dfc-0fc4f561655c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:42.087620 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cdf598b9-14a7-4ce1-9dfc-0fc4f561655c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:42.089239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cdf598b9-14a7-4ce1-9dfc-0fc4f561655c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:42.167563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 531/1074] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:42.189718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8200cd-38e7-4591-adbb-e286fecfd3a1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:42.295482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8200cd-38e7-4591-adbb-e286fecfd3a1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:42.333900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:42.334450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:42.334727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:42.334998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:42.339349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:42.406090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:42.407559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:42.508362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 544/1075] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:42.514825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf598b9-14a7-4ce1-9dfc-0fc4f561655c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:42.599489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:42.616142 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf598b9-14a7-4ce1-9dfc-0fc4f561655c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:42.653930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51039da-b0b5-4994-bdef-81ab5b583706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:42.654882 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51039da-b0b5-4994-bdef-81ab5b583706 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:42.655319 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51039da-b0b5-4994-bdef-81ab5b583706 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:42.655742 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51039da-b0b5-4994-bdef-81ab5b583706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:42.666660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51039da-b0b5-4994-bdef-81ab5b583706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:42.668260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51039da-b0b5-4994-bdef-81ab5b583706 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d51039da-b0b5-4994-bdef-81ab5b583706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:42.683047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:42.684083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:42.685019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:42.685019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:42.685019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:42.686193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 532/1076] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:42.691341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:42.726458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:42.796579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54a84cb-4aa0-464f-9ebd-1ac8a53f97ea None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:42.832953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b1cee2-02fe-4025-b60c-dfb60b17f830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:42.833719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1cee2-02fe-4025-b60c-dfb60b17f830 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:42.834088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1cee2-02fe-4025-b60c-dfb60b17f830 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:42.834473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b1cee2-02fe-4025-b60c-dfb60b17f830 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:42.835214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1cee2-02fe-4025-b60c-dfb60b17f830 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:42.835604 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1cee2-02fe-4025-b60c-dfb60b17f830 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:42.837075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b1cee2-02fe-4025-b60c-dfb60b17f830 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:42.858178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 545/1077] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:42.871450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e629-5838-4a85-a4e2-64cc6f4dc49c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:42.871767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e629-5838-4a85-a4e2-64cc6f4dc49c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:42.871977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4e629-5838-4a85-a4e2-64cc6f4dc49c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:42.873533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 533/1078] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:42.879431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9bdc-e5a3-47fb-a6a3-dda68f8514c8 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:42.879734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9bdc-e5a3-47fb-a6a3-dda68f8514c8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:42.879984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5bf9bdc-e5a3-47fb-a6a3-dda68f8514c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:42.899570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b5bf9bdc-e5a3-47fb-a6a3-dda68f8514c8 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:42.900847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b5bf9bdc-e5a3-47fb-a6a3-dda68f8514c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:42.979462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 546/1079] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:43.001643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e629-5838-4a85-a4e2-64cc6f4dc49c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:43.106788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4e629-5838-4a85-a4e2-64cc6f4dc49c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:43.147971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:43.148874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:43.149297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:43.149984 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:43.153186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:43.163481 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:43.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:43.169377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:43.170513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 534/1080] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:43.177505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9bdc-e5a3-47fb-a6a3-dda68f8514c8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:43.203672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:43.280410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5bf9bdc-e5a3-47fb-a6a3-dda68f8514c8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:43.315746 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:43.316384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:43.316582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:43.316878 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:43.317539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:43.317844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:43.319267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:43.328058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 547/1081] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:43.334043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:43.434789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972bf9d4-57ec-4c4a-88c5-582f8f4e5c27 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:43.469894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:43.470545 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:43.470823 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:43.471094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] PATH_INFO: `/v3/users/b24aa727aa4d4d5ca1ccd5c8c4b30187` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:43.472262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] RBAC: Authorizing `identity:get_user(user_id=b24aa727aa4d4d5ca1ccd5c8c4b30187)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:43.473689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:43.475309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 535/1082] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:43 2022] GET /identity/v3/users/b24aa727aa4d4d5ca1ccd5c8c4b30187 => generated 285 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:43.481310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:43.573153 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:43.586615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd2bfd-8ee8-4927-a57c-05e7463addd1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:43.620448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34840136-b0ec-4068-bbc9-ab1dc9c937a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:43.621072 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34840136-b0ec-4068-bbc9-ab1dc9c937a3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:43.621344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34840136-b0ec-4068-bbc9-ab1dc9c937a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:43.621611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34840136-b0ec-4068-bbc9-ab1dc9c937a3 None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:43.622726 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34840136-b0ec-4068-bbc9-ab1dc9c937a3 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d12619bda849c1be58787795d00b9b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:43.624152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34840136-b0ec-4068-bbc9-ab1dc9c937a3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:43.625754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 548/1083] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:04:43 2022] GET /identity/v3/projects/b3d12619bda849c1be58787795d00b9b => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:43.631941 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:43.700695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:43.739780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dd721a-f91d-4092-a55e-816f4979f3b6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:43.774567 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7beea3ef-dae8-4be8-aafc-4f1baa1384f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:43.784349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beea3ef-dae8-4be8-aafc-4f1baa1384f8 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:43.784349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beea3ef-dae8-4be8-aafc-4f1baa1384f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:43.784349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7beea3ef-dae8-4be8-aafc-4f1baa1384f8 None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b/users/b24aa727aa4d4d5ca1ccd5c8c4b30187/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:43.784349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beea3ef-dae8-4be8-aafc-4f1baa1384f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d12619bda849c1be58787795d00b9b, user_id=b24aa727aa4d4d5ca1ccd5c8c4b30187, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:43.784349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7beea3ef-dae8-4be8-aafc-4f1baa1384f8 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:43.793783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 536/1084] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:04:43 2022] PUT /identity/v3/projects/b3d12619bda849c1be58787795d00b9b/users/b24aa727aa4d4d5ca1ccd5c8c4b30187/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:04:43.861278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f3b2-350b-4120-8d06-0b347b5c8be3 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:43.861546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f3b2-350b-4120-8d06-0b347b5c8be3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:43.861817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597f3b2-350b-4120-8d06-0b347b5c8be3 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:43.863254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 549/1085] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:43.869123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b34b-cee8-444c-8c9e-8712a9fe9d26 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:43.869403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b34b-cee8-444c-8c9e-8712a9fe9d26 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:43.869677 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d458b34b-cee8-444c-8c9e-8712a9fe9d26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:43.889719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d458b34b-cee8-444c-8c9e-8712a9fe9d26 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:43.890987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d458b34b-cee8-444c-8c9e-8712a9fe9d26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:43.970392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 537/1086] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:43.993634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f3b2-350b-4120-8d06-0b347b5c8be3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:44.097860 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597f3b2-350b-4120-8d06-0b347b5c8be3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:44.132599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:44.133219 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:44.133491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:44.133828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:44.144637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:44.149302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:44.150411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:44.151567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 550/1087] 10.222.0.39 () {56 vars in 1120 bytes} [Mon Aug 8 01:04:43 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:44.156915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458b34b-cee8-444c-8c9e-8712a9fe9d26 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:44.215813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:44.261234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d458b34b-cee8-444c-8c9e-8712a9fe9d26 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:44.294562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:44.295182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:44.295457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:44.295727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:44.296395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:44.296698 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:44.298077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:44.306069 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 538/1088] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Aug 8 01:04:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:44.312218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:44.331212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:44.413764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ae3539-9243-4754-8c63-9e6cb1d77d78 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:44.448614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:44.449226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:44.449513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:44.449783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:44.460706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:44.462243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:44.476511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:44.477548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:44.478850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:44.478850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:44.478850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:44.478850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 551/1089] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:44.483641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:44.596221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6957c8-0807-493f-9363-94cd5d91dd03 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:44.612141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:44.630135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:44.630762 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:44.631046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:44.631307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:44.631951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:44.632253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:44.633608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:44.645092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 539/1090] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:44.650951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:44.718243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:44.753156 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2883a741-a990-4b75-a0b3-d715e585bd5d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:44.787921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:44.788551 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:44.788829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:44.789096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:44.797454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:44.798956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:04:44.810647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:44.812130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:44.813403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 552/1091] 10.222.0.39 () {56 vars in 1093 bytes} [Mon Aug 8 01:04:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:44.818037 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:44.923169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954610a1-002d-4654-9586-44e0a19c9f0e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:44.958023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:44.958665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:44.958937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:44.959197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:44.959912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:44.960210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:44.961618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:44.978604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 540/1092] 10.222.0.39 () {56 vars in 1133 bytes} [Mon Aug 8 01:04:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:44.986306 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:45.088031 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30069135-d145-4bfe-b7bf-9e8a05549eb6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:45.116405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:45.127625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:45.128244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:45.128520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:45.128785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:45.198388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:45.199753 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:45.299509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 553/1093] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:45.305529 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:45.343189 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:45.409953 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3671b4-2174-42a3-a105-a36f141b3dc7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:45.444116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:45.444733 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:45.445003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:45.445264 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:45.455657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:45.457023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:04:45.471792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:45.472807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:04:45.473700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:04:45.473700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:04:45.473700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:45.473700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 541/1094] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:45.479255 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:45.507114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:45.580815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ead7bc5-86c1-4a74-9633-dc82ca115887 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:45.615353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5193b5ab-e06a-4865-8a43-0123f19589e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:45.615954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b5ab-e06a-4865-8a43-0123f19589e9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:45.616226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b5ab-e06a-4865-8a43-0123f19589e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:45.616493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5193b5ab-e06a-4865-8a43-0123f19589e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:45.617129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b5ab-e06a-4865-8a43-0123f19589e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:45.617424 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b5ab-e06a-4865-8a43-0123f19589e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:45.619037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5193b5ab-e06a-4865-8a43-0123f19589e9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:45.630857 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 554/1095] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:45.636679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:45.724483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:45.740716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa32294-3ac9-4a74-b3f5-fa106c9db3c0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:45.763047 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639cd27-188c-4adb-b73b-51a328d2b08b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:45.763415 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639cd27-188c-4adb-b73b-51a328d2b08b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:45.763691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3639cd27-188c-4adb-b73b-51a328d2b08b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:45.765090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 555/1096] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:45.770151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892eb2f-0efa-41d1-a612-78339aa221d3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:45.770436 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892eb2f-0efa-41d1-a612-78339aa221d3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:45.770703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2892eb2f-0efa-41d1-a612-78339aa221d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:45.775120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:45.775750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:45.776026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:45.776294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:45.783015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:45.784452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:45.789244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2892eb2f-0efa-41d1-a612-78339aa221d3 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:45.790492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2892eb2f-0efa-41d1-a612-78339aa221d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:04:45.795779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:45.796865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:04:45.797779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 542/1097] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:04:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:45.802609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:45.860662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 556/1098] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:45.883311 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892eb2f-0efa-41d1-a612-78339aa221d3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:45.900950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:45.902721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3ee8ff-b91f-43dd-a036-f12f51bdac0e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:45.937049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:45.937639 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:45.937918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:45.938214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:45.938901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:45.939197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:45.940607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:45.952962 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 543/1099] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:04:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:45.959020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:45.967025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:45.986501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2892eb2f-0efa-41d1-a612-78339aa221d3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:46.019649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:46.020277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:46.020549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:46.020807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:46.030889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:04:46.035545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:04:46.036715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:04:46.038126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 557/1100] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:04:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:04:46.042812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:46.057261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cb104a-a40c-4b8c-80f0-0471d6fe7ddb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:46.091173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:46.091940 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:46.092214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:46.092488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:46.093191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] RBAC: Adding query filter params (role.id=3a0564cda74d4c538041631392b37a8f, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=4a0d809789674bdeaa6763ee4151ca86) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:46.093497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:46.094942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:46.100718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 544/1101] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:45 2022] GET /identity/v3/role_assignments?user.id=4a0d809789674bdeaa6763ee4151ca86&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=3a0564cda74d4c538041631392b37a8f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:46.124804 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:46.148371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140feeb0-7c2d-4d52-93dc-e2281bc62ae8 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:46.186933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:46.187554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:46.187810 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:46.188073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:46.188751 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:46.189049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:46.190460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:46.199809 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 558/1102] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:04:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:46.205936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:46.277453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:46.309864 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9be950-8413-484a-9fc7-35e7e2e8e175 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:46.344093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:46.344717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:46.344995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:46.345262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] PATH_INFO: `/v3/users/b24aa727aa4d4d5ca1ccd5c8c4b30187` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:46.346415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] RBAC: Authorizing `identity:get_user(user_id=b24aa727aa4d4d5ca1ccd5c8c4b30187)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:46.347920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:46.349517 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 545/1103] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:46 2022] GET /identity/v3/users/b24aa727aa4d4d5ca1ccd5c8c4b30187 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:46.355728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:46.460755 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15694a98-0e6d-48f8-92dc-66470fd08650 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:46.493690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:46.494438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:46.494599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:46.494869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:46.505813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:46.570147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:46.571534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:46.671050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 559/1104] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:46.676713 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:46.778270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73af0c-74a3-4c04-b079-ab5cfaf2cee1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:46.812304 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278b1a23-da7a-466a-a002-4506d6aae6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:46.812938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b1a23-da7a-466a-a002-4506d6aae6b2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:46.813210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b1a23-da7a-466a-a002-4506d6aae6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:46.813473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278b1a23-da7a-466a-a002-4506d6aae6b2 None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:46.814634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b1a23-da7a-466a-a002-4506d6aae6b2 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d12619bda849c1be58787795d00b9b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:46.816080 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278b1a23-da7a-466a-a002-4506d6aae6b2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:46.817705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 546/1105] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:04:46 2022] GET /identity/v3/projects/b3d12619bda849c1be58787795d00b9b => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:46.824588 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:46.870960 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:46.930656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52588299-8e8a-490f-b5fd-574dd4b525f6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:46.964171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5638ab0-366b-4a59-9811-96474a8a79f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:46.964759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638ab0-366b-4a59-9811-96474a8a79f8 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:46.965033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638ab0-366b-4a59-9811-96474a8a79f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:46.965298 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5638ab0-366b-4a59-9811-96474a8a79f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:46.966015 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638ab0-366b-4a59-9811-96474a8a79f8 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=b3d12619bda849c1be58787795d00b9b, user.id=b24aa727aa4d4d5ca1ccd5c8c4b30187) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:46.966348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638ab0-366b-4a59-9811-96474a8a79f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:46.967783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5638ab0-366b-4a59-9811-96474a8a79f8 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:46.973314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 560/1106] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:46 2022] GET /identity/v3/role_assignments?user.id=b24aa727aa4d4d5ca1ccd5c8c4b30187&scope.project.id=b3d12619bda849c1be58787795d00b9b&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:48.960231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19654-3ea6-4102-be89-07f7c61fe1fb None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:48.960795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19654-3ea6-4102-be89-07f7c61fe1fb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:48.960795 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e19654-3ea6-4102-be89-07f7c61fe1fb None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:48.962289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 547/1107] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:48.970039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38040-2997-4c48-9c98-b1663db64f9d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:48.970497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38040-2997-4c48-9c98-b1663db64f9d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:48.970591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee38040-2997-4c48-9c98-b1663db64f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:48.993525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4ee38040-2997-4c48-9c98-b1663db64f9d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:48.994738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4ee38040-2997-4c48-9c98-b1663db64f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:49.066942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 561/1108] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:49.092000 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19654-3ea6-4102-be89-07f7c61fe1fb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:49.105616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:49.206796 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e19654-3ea6-4102-be89-07f7c61fe1fb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:49.243012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a58d5a-9bb3-4cb7-8f6a-58458c58cb0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:49.243638 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a58d5a-9bb3-4cb7-8f6a-58458c58cb0a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:49.243915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a58d5a-9bb3-4cb7-8f6a-58458c58cb0a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:49.244185 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a58d5a-9bb3-4cb7-8f6a-58458c58cb0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:49.245432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a58d5a-9bb3-4cb7-8f6a-58458c58cb0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:49.246933 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a58d5a-9bb3-4cb7-8f6a-58458c58cb0a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:49.248506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 548/1109] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:04:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:49.254651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38040-2997-4c48-9c98-b1663db64f9d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:49.293963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:49.364733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee38040-2997-4c48-9c98-b1663db64f9d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:49.401197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a932808-386e-454b-9367-278fbc012406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:49.401796 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932808-386e-454b-9367-278fbc012406 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:49.402093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932808-386e-454b-9367-278fbc012406 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:49.402370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a932808-386e-454b-9367-278fbc012406 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:49.403009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a932808-386e-454b-9367-278fbc012406 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:49.404448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a932808-386e-454b-9367-278fbc012406 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:49.431719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 562/1110] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:04:49 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:04:51.466459 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc8e3-2873-4645-8128-7b076586510e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:51.466969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc8e3-2873-4645-8128-7b076586510e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:51.466969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16bc8e3-2873-4645-8128-7b076586510e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:51.468939 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 549/1111] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:51.476744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c54f-803c-4816-b51f-37b51688ead9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:51.477193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c54f-803c-4816-b51f-37b51688ead9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:51.477303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d066c54f-803c-4816-b51f-37b51688ead9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:51.496136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d066c54f-803c-4816-b51f-37b51688ead9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:51.497304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d066c54f-803c-4816-b51f-37b51688ead9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:51.566038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 563/1112] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:04:51.591163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc8e3-2873-4645-8128-7b076586510e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:51.673084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:51.702991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16bc8e3-2873-4645-8128-7b076586510e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:51.740807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:51.741417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:51.741691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:51.741956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] PATH_INFO: `/v3/roles/0167dcf165304e1390fd26c235128524` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:51.743463 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] RBAC: Authorizing `identity:get_role(role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:51.744827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:51.746154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 550/1113] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:51 2022] GET /identity/v3/roles/0167dcf165304e1390fd26c235128524 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:51.752991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c54f-803c-4816-b51f-37b51688ead9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:51.783095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:51.866016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d066c54f-803c-4816-b51f-37b51688ead9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:51.901191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:51.901809 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:51.902097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:51.902380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] PATH_INFO: `/v3/users/860117e8939c4b9db8f28307a6babdab` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:51.915990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] RBAC: Authorizing `identity:get_user(user_id=860117e8939c4b9db8f28307a6babdab)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:51.917580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:51.919225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 564/1114] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:51 2022] GET /identity/v3/users/860117e8939c4b9db8f28307a6babdab => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:51.925396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:52.031948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb1be73-b564-4200-aba8-3e251208df6d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:52.067527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:52.068125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:52.068399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:52.068664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:52.081207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:52.143819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:52.145270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:52.243964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 551/1115] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:52.250256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:52.350042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:52.380832 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e746bd-bd13-4131-baf0-28a137ef538e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:52.422546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e369a34-d078-45bf-bb74-1d047101a27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:52.423479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369a34-d078-45bf-bb74-1d047101a27b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:52.423869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369a34-d078-45bf-bb74-1d047101a27b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:52.424270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e369a34-d078-45bf-bb74-1d047101a27b None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:52.426289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e369a34-d078-45bf-bb74-1d047101a27b None admin] RBAC: Authorizing `identity:get_project(project_id=b3d12619bda849c1be58787795d00b9b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:52.428617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e369a34-d078-45bf-bb74-1d047101a27b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:52.431160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 565/1116] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:04:52 2022] GET /identity/v3/projects/b3d12619bda849c1be58787795d00b9b => generated 311 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:52.438905 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:52.483425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:52.540791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-716015ca-3ba9-4d87-910a-f727ecf9e129 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:52.576333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca21fbb9-10ab-4bd4-a4ac-17a83d097407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:52.576916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21fbb9-10ab-4bd4-a4ac-17a83d097407 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:52.577186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21fbb9-10ab-4bd4-a4ac-17a83d097407 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:52.577452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca21fbb9-10ab-4bd4-a4ac-17a83d097407 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:52.578187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21fbb9-10ab-4bd4-a4ac-17a83d097407 None admin] RBAC: Adding query filter params (role.id=0167dcf165304e1390fd26c235128524, scope.project.id=b3d12619bda849c1be58787795d00b9b, user.id=860117e8939c4b9db8f28307a6babdab) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:52.578485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21fbb9-10ab-4bd4-a4ac-17a83d097407 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:52.579899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca21fbb9-10ab-4bd4-a4ac-17a83d097407 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:52.585330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 552/1117] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:52 2022] GET /identity/v3/role_assignments?user.id=860117e8939c4b9db8f28307a6babdab&scope.project.id=b3d12619bda849c1be58787795d00b9b&role.id=0167dcf165304e1390fd26c235128524 => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:04:54.548029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf5f6-2a2d-4c5a-8853-14cffd61db96 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:54.548667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf5f6-2a2d-4c5a-8853-14cffd61db96 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:54.548667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630bf5f6-2a2d-4c5a-8853-14cffd61db96 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:54.549923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 566/1118] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:54.556267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ac9a-3cbd-4057-81dd-05f3b4224f72 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:54.556727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ac9a-3cbd-4057-81dd-05f3b4224f72 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:54.556976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e11ac9a-3cbd-4057-81dd-05f3b4224f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:54.577180 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5e11ac9a-3cbd-4057-81dd-05f3b4224f72 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:54.578420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5e11ac9a-3cbd-4057-81dd-05f3b4224f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:54.649411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 553/1119] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:54.671917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bf5f6-2a2d-4c5a-8853-14cffd61db96 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:54.785166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630bf5f6-2a2d-4c5a-8853-14cffd61db96 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:54.823501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:54.824242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:54.824514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:54.824784 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] PATH_INFO: `/v3/roles/0167dcf165304e1390fd26c235128524` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:54.826389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] RBAC: Authorizing `identity:get_role(role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:54.827769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:54.829047 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 567/1120] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:54 2022] GET /identity/v3/roles/0167dcf165304e1390fd26c235128524 => generated 223 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:54.835200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11ac9a-3cbd-4057-81dd-05f3b4224f72 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:54.870715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:54.937656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e11ac9a-3cbd-4057-81dd-05f3b4224f72 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:54.975931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:54.976549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:54.976819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:54.977082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] PATH_INFO: `/v3/users/860117e8939c4b9db8f28307a6babdab` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:54.978346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] RBAC: Authorizing `identity:get_user(user_id=860117e8939c4b9db8f28307a6babdab)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:54.979991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:54.981647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 554/1121] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:54 2022] GET /identity/v3/users/860117e8939c4b9db8f28307a6babdab => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:54.990599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:55.009741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:55.098544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca3143b-a4b1-4ff3-ab04-9b9f5ae92d53 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:55.142668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939182a2-eb42-481d-9a44-8fab34e95ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:55.143304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939182a2-eb42-481d-9a44-8fab34e95ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:55.143582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939182a2-eb42-481d-9a44-8fab34e95ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:55.143850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939182a2-eb42-481d-9a44-8fab34e95ab6 None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:55.145031 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939182a2-eb42-481d-9a44-8fab34e95ab6 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d12619bda849c1be58787795d00b9b)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:55.146513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939182a2-eb42-481d-9a44-8fab34e95ab6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:55.148158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 568/1122] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:04:54 2022] GET /identity/v3/projects/b3d12619bda849c1be58787795d00b9b => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:55.155086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:55.263535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c6933b-097d-4c08-82ee-ac7ab59f81bb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:55.266450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:55.304246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069a15c5-0ac2-45ef-a7d3-916d8c6fb78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:55.304891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a15c5-0ac2-45ef-a7d3-916d8c6fb78e None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:55.305167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a15c5-0ac2-45ef-a7d3-916d8c6fb78e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:55.305431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069a15c5-0ac2-45ef-a7d3-916d8c6fb78e None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b/users/860117e8939c4b9db8f28307a6babdab/roles/0167dcf165304e1390fd26c235128524` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:55.307925 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a15c5-0ac2-45ef-a7d3-916d8c6fb78e None admin] RBAC: Authorizing `identity:create_grant(project_id=b3d12619bda849c1be58787795d00b9b, user_id=860117e8939c4b9db8f28307a6babdab, role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:55.309356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069a15c5-0ac2-45ef-a7d3-916d8c6fb78e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:55.334123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 555/1123] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:04:55 2022] PUT /identity/v3/projects/b3d12619bda849c1be58787795d00b9b/users/860117e8939c4b9db8f28307a6babdab/roles/0167dcf165304e1390fd26c235128524 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:04:57.307655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591771c-a49e-4cef-97f2-0b25e3d40dc4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:57.308206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591771c-a49e-4cef-97f2-0b25e3d40dc4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:57.308206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b591771c-a49e-4cef-97f2-0b25e3d40dc4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:57.309516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 569/1124] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:04:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:04:57.316205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4353-a6e5-4902-88ae-c0b2f321338d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:57.316947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4353-a6e5-4902-88ae-c0b2f321338d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:57.317055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bd4353-a6e5-4902-88ae-c0b2f321338d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:57.339212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d4bd4353-a6e5-4902-88ae-c0b2f321338d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:04:57.340405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d4bd4353-a6e5-4902-88ae-c0b2f321338d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:04:57.412634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 556/1125] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:04:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:04:57.435622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591771c-a49e-4cef-97f2-0b25e3d40dc4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:57.525320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:57.546299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b591771c-a49e-4cef-97f2-0b25e3d40dc4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:57.584173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:57.584781 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:57.585052 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:57.585320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] PATH_INFO: `/v3/roles/0167dcf165304e1390fd26c235128524` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:57.586760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] RBAC: Authorizing `identity:get_role(role_id=0167dcf165304e1390fd26c235128524)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:57.588133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:57.589529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 570/1126] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:57 2022] GET /identity/v3/roles/0167dcf165304e1390fd26c235128524 => generated 223 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:57.595637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd4353-a6e5-4902-88ae-c0b2f321338d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:57.692994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:57.701607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bd4353-a6e5-4902-88ae-c0b2f321338d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:57.735237 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:57.735853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:57.736128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:57.736394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] PATH_INFO: `/v3/users/860117e8939c4b9db8f28307a6babdab` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:57.737523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] RBAC: Authorizing `identity:get_user(user_id=860117e8939c4b9db8f28307a6babdab)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:57.738975 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:57.740520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 557/1127] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:04:57 2022] GET /identity/v3/users/860117e8939c4b9db8f28307a6babdab => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:57.746650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:57.853258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce2e203-460d-4667-ac79-893a14c29263 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:57.888687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:57.889271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:57.889543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:57.889803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:57.908420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:57.959047 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:57.960414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:58.059458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 571/1128] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:04:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:04:58.065951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:58.177283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7699de-604a-4378-9ba0-d7bc0b93ed7a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:58.224461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c63db-85c5-4624-8646-17738a768935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:58.225110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c63db-85c5-4624-8646-17738a768935 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:58.225362 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c63db-85c5-4624-8646-17738a768935 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:58.225629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c63db-85c5-4624-8646-17738a768935 None admin] PATH_INFO: `/v3/projects/b3d12619bda849c1be58787795d00b9b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:58.227413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c63db-85c5-4624-8646-17738a768935 None admin] RBAC: Authorizing `identity:get_project(project_id=b3d12619bda849c1be58787795d00b9b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:58.229950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c63db-85c5-4624-8646-17738a768935 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:58.232654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 558/1129] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:04:58 2022] GET /identity/v3/projects/b3d12619bda849c1be58787795d00b9b => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:04:58.242242 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:04:58.301346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:04:58.353288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a728ca-9e6c-4c32-82a4-7d57a5c16464 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:04:58.398808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212fa967-c4d6-4b7d-a964-6987cc76b8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:04:58.399708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa967-c4d6-4b7d-a964-6987cc76b8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:04:58.400063 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa967-c4d6-4b7d-a964-6987cc76b8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:04:58.400454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212fa967-c4d6-4b7d-a964-6987cc76b8b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:04:58.401547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fa967-c4d6-4b7d-a964-6987cc76b8b9 None admin] RBAC: Adding query filter params (role.id=0167dcf165304e1390fd26c235128524, scope.project.id=b3d12619bda849c1be58787795d00b9b, user.id=860117e8939c4b9db8f28307a6babdab) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:04:58.401977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fa967-c4d6-4b7d-a964-6987cc76b8b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:04:58.403463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212fa967-c4d6-4b7d-a964-6987cc76b8b9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:04:58.409771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 572/1130] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:04:58 2022] GET /identity/v3/role_assignments?user.id=860117e8939c4b9db8f28307a6babdab&scope.project.id=b3d12619bda849c1be58787795d00b9b&role.id=0167dcf165304e1390fd26c235128524 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:00.406364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a397-ac25-4e1d-bd26-efd2425b3f5e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:00.406914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a397-ac25-4e1d-bd26-efd2425b3f5e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:00.406914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d9a397-ac25-4e1d-bd26-efd2425b3f5e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:00.408189 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 559/1131] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:00.413532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541932-8edd-4445-a9d8-e06c6c1414b9 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:00.413949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541932-8edd-4445-a9d8-e06c6c1414b9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:00.414038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16541932-8edd-4445-a9d8-e06c6c1414b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:00.434729 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-16541932-8edd-4445-a9d8-e06c6c1414b9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:00.436259 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-16541932-8edd-4445-a9d8-e06c6c1414b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:00.505623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 573/1132] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:00.528938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9a397-ac25-4e1d-bd26-efd2425b3f5e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:00.564093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:00.642756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d9a397-ac25-4e1d-bd26-efd2425b3f5e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:00.680136 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e75ab-cc7b-462b-8046-84ccf12bd21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:00.680689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e75ab-cc7b-462b-8046-84ccf12bd21f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:00.680972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e75ab-cc7b-462b-8046-84ccf12bd21f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:00.681245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e75ab-cc7b-462b-8046-84ccf12bd21f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:00.682469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e75ab-cc7b-462b-8046-84ccf12bd21f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:00.683874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e75ab-cc7b-462b-8046-84ccf12bd21f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:00.685415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 560/1133] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:05:00 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:00.692310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16541932-8edd-4445-a9d8-e06c6c1414b9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:00.750434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:00.805178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16541932-8edd-4445-a9d8-e06c6c1414b9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:00.840800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58769307-73f4-4227-a126-3807ab8e4c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:00.841390 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769307-73f4-4227-a126-3807ab8e4c9a None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:00.841659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769307-73f4-4227-a126-3807ab8e4c9a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:00.841923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58769307-73f4-4227-a126-3807ab8e4c9a None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:00.842601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58769307-73f4-4227-a126-3807ab8e4c9a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:00.844043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58769307-73f4-4227-a126-3807ab8e4c9a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:00.876140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 574/1134] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:05:00 2022] POST /identity/v3/projects => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:05:02.874964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930933-32da-432c-a7a4-267bdc4c0440 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:02.875564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930933-32da-432c-a7a4-267bdc4c0440 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:02.875564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19930933-32da-432c-a7a4-267bdc4c0440 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:02.876835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 561/1135] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:02.883151 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d365d-52c4-4899-ba2b-9cd1353864e6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:02.883869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d365d-52c4-4899-ba2b-9cd1353864e6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:02.884007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368d365d-52c4-4899-ba2b-9cd1353864e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:02.910582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-368d365d-52c4-4899-ba2b-9cd1353864e6 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:02.911780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-368d365d-52c4-4899-ba2b-9cd1353864e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:02.985853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 575/1136] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:03.014166 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930933-32da-432c-a7a4-267bdc4c0440 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:03.122687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:03.129001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19930933-32da-432c-a7a4-267bdc4c0440 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:03.168239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e616aa0c-200b-470b-a46c-4e015b64176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:03.168856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616aa0c-200b-470b-a46c-4e015b64176f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:03.169129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616aa0c-200b-470b-a46c-4e015b64176f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:03.169395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e616aa0c-200b-470b-a46c-4e015b64176f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:03.170567 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616aa0c-200b-470b-a46c-4e015b64176f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:03.171985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e616aa0c-200b-470b-a46c-4e015b64176f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:03.173577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 562/1137] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:05:03 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:03.182254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d365d-52c4-4899-ba2b-9cd1353864e6 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:03.210313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:03.287546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368d365d-52c4-4899-ba2b-9cd1353864e6 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:03.323679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7734f2cf-aafa-4785-86f7-a22076a96835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:03.324307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734f2cf-aafa-4785-86f7-a22076a96835 None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:03.324581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734f2cf-aafa-4785-86f7-a22076a96835 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:03.324851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7734f2cf-aafa-4785-86f7-a22076a96835 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:03.325524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734f2cf-aafa-4785-86f7-a22076a96835 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:03.327006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7734f2cf-aafa-4785-86f7-a22076a96835 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:03.351877 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 576/1138] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:05:03 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:05:05.546198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980074a-1552-47b2-8e3c-59ad8835c8a8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:05.546768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980074a-1552-47b2-8e3c-59ad8835c8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:05.546768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0980074a-1552-47b2-8e3c-59ad8835c8a8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:05.548141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 563/1139] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:05.553662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c21f32-66e0-4da2-ab0b-baebb6ec0bf3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:05.554039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c21f32-66e0-4da2-ab0b-baebb6ec0bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:05.554259 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c21f32-66e0-4da2-ab0b-baebb6ec0bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:05.579919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c1c21f32-66e0-4da2-ab0b-baebb6ec0bf3 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:05.581136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1c21f32-66e0-4da2-ab0b-baebb6ec0bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:05.662131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 577/1140] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:05.684847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980074a-1552-47b2-8e3c-59ad8835c8a8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:05.803523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0980074a-1552-47b2-8e3c-59ad8835c8a8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:05.839562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:05.840171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:05.840441 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:05.840699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:05.850776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:05:05.855850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:05:05.856956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:05:05.857853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 564/1141] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:05:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:05:05.863883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c21f32-66e0-4da2-ab0b-baebb6ec0bf3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:05.880188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:05.968236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c21f32-66e0-4da2-ab0b-baebb6ec0bf3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:06.003500 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:06.004095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:06.004368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:06.004637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:06.005292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:06.005590 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:06.006995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:06.015009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 578/1142] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:05:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:06.024265 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:06.056081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:06.133457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ff85ba-7976-4113-8f1f-078958c61da5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:06.170568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:06.171187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:06.171459 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:06.171729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] PATH_INFO: `/v3/users/8e2d5504e5f547278b9893a8dd192c39` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:06.185050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2d5504e5f547278b9893a8dd192c39)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:06.186868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:06.188476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 565/1143] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:05:06 2022] GET /identity/v3/users/8e2d5504e5f547278b9893a8dd192c39 => generated 286 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:06.198089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:06.278820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:06.306590 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b608977-fdfe-4638-8a2f-6def9473be86 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:06.341252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:06.341850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:06.342128 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:06.342400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:06.416281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:06.417777 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:06.491986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:06.518722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 579/1144] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:05:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:05:06.525489 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:06.627653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:06.645135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ee875-9701-4d86-b849-4229f35feb54 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:06.680116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712ac4c7-fa66-4414-845e-243754445f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:06.680726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac4c7-fa66-4414-845e-243754445f13 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:06.680993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac4c7-fa66-4414-845e-243754445f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:06.681259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ac4c7-fa66-4414-845e-243754445f13 None admin] PATH_INFO: `/v3/projects/dae8b3d47a514213b7a155c08a39472e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:06.682521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ac4c7-fa66-4414-845e-243754445f13 None admin] RBAC: Authorizing `identity:get_project(project_id=dae8b3d47a514213b7a155c08a39472e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:06.683934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-712ac4c7-fa66-4414-845e-243754445f13 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:06.685879 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 566/1145] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:05:06 2022] GET /identity/v3/projects/dae8b3d47a514213b7a155c08a39472e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:06.692747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:06.813338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a92ef26-6619-40ec-a248-ba000940e0aa None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:06.850617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8c9edd-a526-46a3-a899-0cd214ce9cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:06.851202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9edd-a526-46a3-a899-0cd214ce9cc0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:06.851479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9edd-a526-46a3-a899-0cd214ce9cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:06.851747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8c9edd-a526-46a3-a899-0cd214ce9cc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:06.852463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c9edd-a526-46a3-a899-0cd214ce9cc0 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=dae8b3d47a514213b7a155c08a39472e, user.id=8e2d5504e5f547278b9893a8dd192c39) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:06.852762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c9edd-a526-46a3-a899-0cd214ce9cc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:06.854248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8c9edd-a526-46a3-a899-0cd214ce9cc0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:06.859578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 580/1146] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:05:06 2022] GET /identity/v3/role_assignments?user.id=8e2d5504e5f547278b9893a8dd192c39&scope.project.id=dae8b3d47a514213b7a155c08a39472e&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:08.932992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e77b2-24da-4d2f-a212-9c0f359bf3d8 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:08.933559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e77b2-24da-4d2f-a212-9c0f359bf3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:08.933559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4e77b2-24da-4d2f-a212-9c0f359bf3d8 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:08.934904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 567/1147] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:08.941639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb458-212f-4656-ad3a-d23fa9a90117 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:08.942417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb458-212f-4656-ad3a-d23fa9a90117 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:08.942553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792fb458-212f-4656-ad3a-d23fa9a90117 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:08.969628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-792fb458-212f-4656-ad3a-d23fa9a90117 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:08.970842 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-792fb458-212f-4656-ad3a-d23fa9a90117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:09.003628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:09.045778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 581/1148] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:09.068158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e77b2-24da-4d2f-a212-9c0f359bf3d8 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:09.175234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4e77b2-24da-4d2f-a212-9c0f359bf3d8 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:09.225416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:09.226034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:09.226354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:09.226621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:09.237711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:05:09.242411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:05:09.243447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:05:09.244994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 568/1149] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:05:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:05:09.253027 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb458-212f-4656-ad3a-d23fa9a90117 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:09.367024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792fb458-212f-4656-ad3a-d23fa9a90117 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:09.403336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:09.403934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:09.404209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:09.404472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:09.405240 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:09.405595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:09.407009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:09.415646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 582/1150] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:05:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:09.423361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:09.440890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:09.527967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8f526e-e2c6-4969-a3a3-da1b2f530c6a None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:09.563666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:09.564281 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:09.564555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:09.564823 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] PATH_INFO: `/v3/users/8e2d5504e5f547278b9893a8dd192c39` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:09.566101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2d5504e5f547278b9893a8dd192c39)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:09.567542 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:09.569102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 569/1151] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:05:09 2022] GET /identity/v3/users/8e2d5504e5f547278b9893a8dd192c39 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:09.575803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:09.614191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:09.689109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46fa08ca-99f6-40b9-a673-9ef78d0c3db0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:09.726697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24341524-092a-4a19-bd00-83791eaa7682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:09.727316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24341524-092a-4a19-bd00-83791eaa7682 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:09.727583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24341524-092a-4a19-bd00-83791eaa7682 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:09.727849 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24341524-092a-4a19-bd00-83791eaa7682 None admin] PATH_INFO: `/v3/projects/dae8b3d47a514213b7a155c08a39472e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:09.728994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24341524-092a-4a19-bd00-83791eaa7682 None admin] RBAC: Authorizing `identity:get_project(project_id=dae8b3d47a514213b7a155c08a39472e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:09.730659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24341524-092a-4a19-bd00-83791eaa7682 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:09.732290 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 583/1152] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:05:09 2022] GET /identity/v3/projects/dae8b3d47a514213b7a155c08a39472e => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:09.738967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:09.827647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:09.847625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d98160-09c1-4f49-8434-fbf68be908f0 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:09.882720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcd53cf-945e-4d73-815a-65e575452ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:09.883368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53cf-945e-4d73-815a-65e575452ab3 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:09.883643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53cf-945e-4d73-815a-65e575452ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:09.883913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcd53cf-945e-4d73-815a-65e575452ab3 None admin] PATH_INFO: `/v3/projects/dae8b3d47a514213b7a155c08a39472e/users/8e2d5504e5f547278b9893a8dd192c39/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:09.886350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd53cf-945e-4d73-815a-65e575452ab3 None admin] RBAC: Authorizing `identity:create_grant(project_id=dae8b3d47a514213b7a155c08a39472e, user_id=8e2d5504e5f547278b9893a8dd192c39, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:09.887833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcd53cf-945e-4d73-815a-65e575452ab3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:09.906801 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 570/1153] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:05:09 2022] PUT /identity/v3/projects/dae8b3d47a514213b7a155c08a39472e/users/8e2d5504e5f547278b9893a8dd192c39/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:05:11.855771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb39233-d936-45ae-8882-3a2ef7a18979 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:11.856336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb39233-d936-45ae-8882-3a2ef7a18979 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:11.856336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb39233-d936-45ae-8882-3a2ef7a18979 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:11.857641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 584/1154] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:11.864174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acbc4-796c-4a15-a057-b793f0b7b13d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:11.864952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acbc4-796c-4a15-a057-b793f0b7b13d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:11.865093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401acbc4-796c-4a15-a057-b793f0b7b13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:11.888181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-401acbc4-796c-4a15-a057-b793f0b7b13d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:11.889392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-401acbc4-796c-4a15-a057-b793f0b7b13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:11.966460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 571/1155] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:11.989305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb39233-d936-45ae-8882-3a2ef7a18979 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:12.092530 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:12.097591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb39233-d936-45ae-8882-3a2ef7a18979 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:12.134392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:12.135186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:12.135531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:12.135857 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:12.146386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:05:12.151368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:05:12.152486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:12.153371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:05:12.157612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 585/1156] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:05:12.158701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401acbc4-796c-4a15-a057-b793f0b7b13d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:12.232814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:12.279955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401acbc4-796c-4a15-a057-b793f0b7b13d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:12.318091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:12.318715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:12.318997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:12.319264 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:12.319918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:12.320218 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:12.321556 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:12.330188 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 572/1157] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:05:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:05:12.336710 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:12.458541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd93532-84c0-4918-bfa6-5c15a0a89b27 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:12.492378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:12.492982 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:12.493255 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:12.493519 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] PATH_INFO: `/v3/users/8e2d5504e5f547278b9893a8dd192c39` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:12.494916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] RBAC: Authorizing `identity:get_user(user_id=8e2d5504e5f547278b9893a8dd192c39)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:12.496345 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:12.497893 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 586/1158] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:05:12 2022] GET /identity/v3/users/8e2d5504e5f547278b9893a8dd192c39 => generated 286 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:12.503994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:12.611192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d4d8a7-c8f9-49e1-a299-46ffe36c27a6 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:12.641431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:12.647203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:12.647793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:12.648064 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:12.648334 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:12.720046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:12.721461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:12.835188 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 573/1159] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:05:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:05:12.843175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:12.888521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:12.967410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7d6833-a47a-4eb9-a39c-2a507405a3b2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:13.006077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80aa2191-122c-4f74-ae96-ed5f8b14cbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:13.006633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa2191-122c-4f74-ae96-ed5f8b14cbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:13.006907 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa2191-122c-4f74-ae96-ed5f8b14cbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:13.007172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80aa2191-122c-4f74-ae96-ed5f8b14cbd1 None admin] PATH_INFO: `/v3/projects/dae8b3d47a514213b7a155c08a39472e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:13.008402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa2191-122c-4f74-ae96-ed5f8b14cbd1 None admin] RBAC: Authorizing `identity:get_project(project_id=dae8b3d47a514213b7a155c08a39472e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:13.009930 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80aa2191-122c-4f74-ae96-ed5f8b14cbd1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:13.011586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 587/1160] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:05:12 2022] GET /identity/v3/projects/dae8b3d47a514213b7a155c08a39472e => generated 311 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:13.018086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:13.052566 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:13.131024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906a2c46-59bd-4471-b671-d76c5e87fbf2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:13.166747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84da0d76-8f8c-463d-bca1-fbfb5d453b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:13.167337 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da0d76-8f8c-463d-bca1-fbfb5d453b32 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:13.167612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da0d76-8f8c-463d-bca1-fbfb5d453b32 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:13.167881 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84da0d76-8f8c-463d-bca1-fbfb5d453b32 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:13.168600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da0d76-8f8c-463d-bca1-fbfb5d453b32 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=dae8b3d47a514213b7a155c08a39472e, user.id=8e2d5504e5f547278b9893a8dd192c39) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:13.168940 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da0d76-8f8c-463d-bca1-fbfb5d453b32 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:13.170380 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84da0d76-8f8c-463d-bca1-fbfb5d453b32 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:13.176224 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 574/1161] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:05:13 2022] GET /identity/v3/role_assignments?user.id=8e2d5504e5f547278b9893a8dd192c39&scope.project.id=dae8b3d47a514213b7a155c08a39472e&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:15.190122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dcf0-ccd0-40ee-b05e-70cc2a0beaa4 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:15.190985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dcf0-ccd0-40ee-b05e-70cc2a0beaa4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:15.191110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d029dcf0-ccd0-40ee-b05e-70cc2a0beaa4 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:15.193197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 588/1162] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:15.198784 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c090b-d334-42ff-a2dd-4e36ed8c329c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:15.199232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c090b-d334-42ff-a2dd-4e36ed8c329c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:15.199325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8c090b-d334-42ff-a2dd-4e36ed8c329c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:15.218564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ff8c090b-d334-42ff-a2dd-4e36ed8c329c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:15.219747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ff8c090b-d334-42ff-a2dd-4e36ed8c329c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:15.298446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 575/1163] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:15.321230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029dcf0-ccd0-40ee-b05e-70cc2a0beaa4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:15.434581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:15.444494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d029dcf0-ccd0-40ee-b05e-70cc2a0beaa4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:15.482798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:15.483393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:15.483672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:15.483939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:15.558861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:15.561452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:15.669765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:15.678098 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 589/1164] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:05:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:05:15.685259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c090b-d334-42ff-a2dd-4e36ed8c329c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:15.712083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:15.788905 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8c090b-d334-42ff-a2dd-4e36ed8c329c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:15.825248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf778de5-74d4-432e-9f3e-e2217b8b1a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:15.825890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778de5-74d4-432e-9f3e-e2217b8b1a32 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:15.826177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778de5-74d4-432e-9f3e-e2217b8b1a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:15.826455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf778de5-74d4-432e-9f3e-e2217b8b1a32 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:15.834629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf778de5-74d4-432e-9f3e-e2217b8b1a32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:15.836114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf778de5-74d4-432e-9f3e-e2217b8b1a32 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-cf778de5-74d4-432e-9f3e-e2217b8b1a32 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:05:15.848072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:05:15.849241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:05:15.850403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 576/1165] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:05:15 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:05:15.855548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:15.957105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4e1c2-11ce-4176-a2fc-fc114df35a1d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:15.991957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f3304f-a289-4b45-9023-ba4b91d3f3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:15.992537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3304f-a289-4b45-9023-ba4b91d3f3ee None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:15.992808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3304f-a289-4b45-9023-ba4b91d3f3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:15.993069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3304f-a289-4b45-9023-ba4b91d3f3ee None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:15.993704 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3304f-a289-4b45-9023-ba4b91d3f3ee None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:15.994103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3304f-a289-4b45-9023-ba4b91d3f3ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:15.995424 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f3304f-a289-4b45-9023-ba4b91d3f3ee None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:16.002478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 590/1166] 10.222.0.39 () {56 vars in 1115 bytes} [Mon Aug 8 01:05:15 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:17.969663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9549d2-b779-4e0c-978e-d28fd2da3589 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:17.970316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9549d2-b779-4e0c-978e-d28fd2da3589 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:17.970316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9549d2-b779-4e0c-978e-d28fd2da3589 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:17.971584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 577/1167] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:17.977830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316a1df-0c56-4fc4-aca1-342c0e5ce379 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:17.978318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316a1df-0c56-4fc4-aca1-342c0e5ce379 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:17.978411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b316a1df-0c56-4fc4-aca1-342c0e5ce379 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:18.002385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b316a1df-0c56-4fc4-aca1-342c0e5ce379 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:18.003585 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b316a1df-0c56-4fc4-aca1-342c0e5ce379 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:18.060569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:18.082954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 591/1168] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:18.107287 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9549d2-b779-4e0c-978e-d28fd2da3589 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:18.210854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:18.228547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9549d2-b779-4e0c-978e-d28fd2da3589 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:18.267103 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3d9df1-4e1d-4763-9989-935acec8295b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:18.267991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d9df1-4e1d-4763-9989-935acec8295b None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:18.268371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d9df1-4e1d-4763-9989-935acec8295b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:18.268728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3d9df1-4e1d-4763-9989-935acec8295b None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:18.269714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d9df1-4e1d-4763-9989-935acec8295b None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:18.271924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3d9df1-4e1d-4763-9989-935acec8295b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:18.296096 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 578/1169] 10.222.0.39 () {60 vars in 1138 bytes} [Mon Aug 8 01:05:18 2022] POST /identity/v3/domains => generated 267 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:05:20.291737 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8aa99-5e4c-4243-aff4-7f501446d046 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:20.292288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8aa99-5e4c-4243-aff4-7f501446d046 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:20.292288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c8aa99-5e4c-4243-aff4-7f501446d046 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:20.293618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 592/1170] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:20.298995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62063d-7006-4977-997c-d11ce38ffc22 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:20.299420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62063d-7006-4977-997c-d11ce38ffc22 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:20.299510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e62063d-7006-4977-997c-d11ce38ffc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:20.319721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4e62063d-7006-4977-997c-d11ce38ffc22 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:20.320884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4e62063d-7006-4977-997c-d11ce38ffc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:20.394023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 579/1171] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:20.417116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8aa99-5e4c-4243-aff4-7f501446d046 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:20.529070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c8aa99-5e4c-4243-aff4-7f501446d046 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:20.567481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda077c6-49b0-477a-bfaf-64d7f248be9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:20.568097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda077c6-49b0-477a-bfaf-64d7f248be9f None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:20.568372 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda077c6-49b0-477a-bfaf-64d7f248be9f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:20.568643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda077c6-49b0-477a-bfaf-64d7f248be9f None admin] PATH_INFO: `/v3/domains/aae19b8781b04824a3f8165df03862e9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:20.580033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda077c6-49b0-477a-bfaf-64d7f248be9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=aae19b8781b04824a3f8165df03862e9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:20.581483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda077c6-49b0-477a-bfaf-64d7f248be9f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:20.583097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 593/1172] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Aug 8 01:05:20 2022] GET /identity/v3/domains/aae19b8781b04824a3f8165df03862e9 => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:20.589399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62063d-7006-4977-997c-d11ce38ffc22 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:20.675102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:20.700898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e62063d-7006-4977-997c-d11ce38ffc22 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:20.736470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a50072-3e14-4427-b853-a436fb35f58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:20.737071 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50072-3e14-4427-b853-a436fb35f58d None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:20.737351 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50072-3e14-4427-b853-a436fb35f58d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:20.737623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a50072-3e14-4427-b853-a436fb35f58d None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:20.738298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50072-3e14-4427-b853-a436fb35f58d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:20.739726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a50072-3e14-4427-b853-a436fb35f58d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:20.770651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 580/1173] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:05:20 2022] POST /identity/v3/projects => generated 361 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:05:22.767094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fea35-f421-41ee-a648-b8fe536e52d8 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:22.767940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fea35-f421-41ee-a648-b8fe536e52d8 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:22.767940 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0fea35-f421-41ee-a648-b8fe536e52d8 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:22.770124 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 594/1174] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:22.777500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2829aa4-099d-4420-8dd5-213d5e75cb2d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:22.777894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2829aa4-099d-4420-8dd5-213d5e75cb2d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:22.778045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2829aa4-099d-4420-8dd5-213d5e75cb2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:22.797465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c2829aa4-099d-4420-8dd5-213d5e75cb2d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:22.798690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c2829aa4-099d-4420-8dd5-213d5e75cb2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:22.876091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 581/1175] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:22.900953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fea35-f421-41ee-a648-b8fe536e52d8 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:22.956020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:23.021556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0fea35-f421-41ee-a648-b8fe536e52d8 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:23.058751 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d4034-9d60-42dc-aba1-9533ceb0e5fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:23.059706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4034-9d60-42dc-aba1-9533ceb0e5fc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:23.059983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4034-9d60-42dc-aba1-9533ceb0e5fc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:23.060252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d4034-9d60-42dc-aba1-9533ceb0e5fc None admin] PATH_INFO: `/v3/domains/aae19b8781b04824a3f8165df03862e9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:23.061471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d4034-9d60-42dc-aba1-9533ceb0e5fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=aae19b8781b04824a3f8165df03862e9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:23.062942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d4034-9d60-42dc-aba1-9533ceb0e5fc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:23.064506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 595/1176] 10.222.0.39 () {56 vars in 1183 bytes} [Mon Aug 8 01:05:22 2022] GET /identity/v3/domains/aae19b8781b04824a3f8165df03862e9 => generated 267 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:23.073263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2829aa4-099d-4420-8dd5-213d5e75cb2d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:23.140651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:23.183192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2829aa4-099d-4420-8dd5-213d5e75cb2d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:23.218331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baeb62b-0c6d-48f2-bde4-2cd100583771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:23.218936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb62b-0c6d-48f2-bde4-2cd100583771 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:23.219227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb62b-0c6d-48f2-bde4-2cd100583771 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:23.219476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baeb62b-0c6d-48f2-bde4-2cd100583771 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:23.220107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeb62b-0c6d-48f2-bde4-2cd100583771 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:23.221536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9baeb62b-0c6d-48f2-bde4-2cd100583771 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:23.248349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 582/1177] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:05:23 2022] POST /identity/v3/users => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:05:25.378516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78da5-0a23-4aba-84c3-a55027feb23e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:25.379077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78da5-0a23-4aba-84c3-a55027feb23e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:25.379077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f78da5-0a23-4aba-84c3-a55027feb23e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:25.380976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 596/1178] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:25 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:25.387836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511ff7-35b7-4181-a078-09d10941be57 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:25.388310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511ff7-35b7-4181-a078-09d10941be57 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:25.388421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd511ff7-35b7-4181-a078-09d10941be57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:25.408672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cd511ff7-35b7-4181-a078-09d10941be57 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:25.409847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cd511ff7-35b7-4181-a078-09d10941be57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:25.483669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 583/1179] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:05:25.506990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f78da5-0a23-4aba-84c3-a55027feb23e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:25.617066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f78da5-0a23-4aba-84c3-a55027feb23e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:25.633147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:25.654786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:25.655416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:25.655687 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:25.655950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:25.667385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:05:25.672006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:05:25.673123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:05:25.674216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 597/1180] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:05:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:05:25.682125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd511ff7-35b7-4181-a078-09d10941be57 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:25.739156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:25.802849 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd511ff7-35b7-4181-a078-09d10941be57 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:25.840772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:25.841382 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:25.841654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:25.841924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:25.842623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:25.842909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:25.844291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:25.852681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 584/1181] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:05:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:25.858948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:25.973007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc438215-8537-4fb0-a5b8-9a852b05cfde None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:26.008529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:26.009315 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:26.009581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:26.009856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] PATH_INFO: `/v3/users/36b34abbbfa74c92bc49935c81c2170e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:26.023435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] RBAC: Authorizing `identity:get_user(user_id=36b34abbbfa74c92bc49935c81c2170e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:26.024939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:26.026548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 598/1182] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:05:25 2022] GET /identity/v3/users/36b34abbbfa74c92bc49935c81c2170e => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:26.035528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:26.139286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eeb22fd-50bb-442e-a062-81c117f7a0fb None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:26.146090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:26.174523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:26.175120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:26.175392 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:26.175653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:26.248497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:26.249899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:26.349225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 585/1183] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:05:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:05:26.356991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:26.394354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:26.463251 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2babcbc4-a2ad-4bcb-9328-15ad6b4fca87 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:26.501880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a8658c-ac5c-4ccc-b73a-e9d3af0942e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:26.502514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8658c-ac5c-4ccc-b73a-e9d3af0942e4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:26.502791 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8658c-ac5c-4ccc-b73a-e9d3af0942e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:26.503067 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a8658c-ac5c-4ccc-b73a-e9d3af0942e4 None admin] PATH_INFO: `/v3/projects/657eceef7274491e950f321680942cba` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:26.504191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8658c-ac5c-4ccc-b73a-e9d3af0942e4 None admin] RBAC: Authorizing `identity:get_project(project_id=657eceef7274491e950f321680942cba)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:26.505625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a8658c-ac5c-4ccc-b73a-e9d3af0942e4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:26.507271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 599/1184] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:05:26 2022] GET /identity/v3/projects/657eceef7274491e950f321680942cba => generated 361 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:26.516832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:26.525690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:26.621972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773c10c-7056-4574-a73c-7738f01676fc None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:26.660235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058a13b-a766-4407-a54f-2bc19d062b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:26.660819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a13b-a766-4407-a54f-2bc19d062b7e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:26.661090 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a13b-a766-4407-a54f-2bc19d062b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:26.661356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058a13b-a766-4407-a54f-2bc19d062b7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:26.662091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058a13b-a766-4407-a54f-2bc19d062b7e None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=657eceef7274491e950f321680942cba, user.id=36b34abbbfa74c92bc49935c81c2170e) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:26.662399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058a13b-a766-4407-a54f-2bc19d062b7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:26.663806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9058a13b-a766-4407-a54f-2bc19d062b7e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:26.669442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 586/1185] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:05:26 2022] GET /identity/v3/role_assignments?user.id=36b34abbbfa74c92bc49935c81c2170e&scope.project.id=657eceef7274491e950f321680942cba&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:05:28.607455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71ea4-92e7-41ff-92fa-aa1da3cf85db None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:28.608409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71ea4-92e7-41ff-92fa-aa1da3cf85db None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:28.608409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e71ea4-92e7-41ff-92fa-aa1da3cf85db None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:28.610594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 600/1186] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:28 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:28.616741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c6d-f4d1-4274-9051-15b66fe85370 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:28.617512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c6d-f4d1-4274-9051-15b66fe85370 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:28.617654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65744c6d-f4d1-4274-9051-15b66fe85370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:28.642362 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-65744c6d-f4d1-4274-9051-15b66fe85370 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:28.643555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-65744c6d-f4d1-4274-9051-15b66fe85370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:28.708069 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:28.715554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 587/1187] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:28.737576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e71ea4-92e7-41ff-92fa-aa1da3cf85db None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:28.842573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e71ea4-92e7-41ff-92fa-aa1da3cf85db None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:28.844224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:28.890367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:28.891127 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:28.891488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:28.891870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:28.903510 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:05:28.908105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:05:28.909187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:05:28.910422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 601/1188] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:05:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:05:28.915508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744c6d-f4d1-4274-9051-15b66fe85370 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:29.025658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65744c6d-f4d1-4274-9051-15b66fe85370 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:29.064811 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:29.065759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:29.066117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:29.066475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:29.067477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:29.067881 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:29.070004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:29.078965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 588/1189] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:05:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:29.087843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:29.201057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9332c07b-8630-40f8-9425-40d1de0e7e38 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:29.243166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:29.243759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:29.244038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:29.244314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] PATH_INFO: `/v3/users/36b34abbbfa74c92bc49935c81c2170e` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:29.245504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] RBAC: Authorizing `identity:get_user(user_id=36b34abbbfa74c92bc49935c81c2170e)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:29.247003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:29.248616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 602/1190] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:05:29 2022] GET /identity/v3/users/36b34abbbfa74c92bc49935c81c2170e => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:29.254855 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:29.321527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:29.372430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8cc0a1-7dfb-4212-afc5-192d0eaf020e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:29.406897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d0aae4-1722-427f-852f-14acb4e79d60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:29.407506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aae4-1722-427f-852f-14acb4e79d60 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:29.407778 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aae4-1722-427f-852f-14acb4e79d60 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:29.408047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d0aae4-1722-427f-852f-14acb4e79d60 None admin] PATH_INFO: `/v3/projects/657eceef7274491e950f321680942cba` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:29.409260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0aae4-1722-427f-852f-14acb4e79d60 None admin] RBAC: Authorizing `identity:get_project(project_id=657eceef7274491e950f321680942cba)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:29.410719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d0aae4-1722-427f-852f-14acb4e79d60 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:29.412330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 589/1191] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:05:29 2022] GET /identity/v3/projects/657eceef7274491e950f321680942cba => generated 361 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:29.419232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:29.457287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:29.528601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc01c06b-b90e-4651-8125-d58cb1d3a630 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:29.567349 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abe2f0f-8224-4a8f-b753-09d92303c863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:29.567993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2f0f-8224-4a8f-b753-09d92303c863 None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:29.568272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2f0f-8224-4a8f-b753-09d92303c863 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:29.568546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abe2f0f-8224-4a8f-b753-09d92303c863 None admin] PATH_INFO: `/v3/projects/657eceef7274491e950f321680942cba/users/36b34abbbfa74c92bc49935c81c2170e/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:29.570745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe2f0f-8224-4a8f-b753-09d92303c863 None admin] RBAC: Authorizing `identity:create_grant(project_id=657eceef7274491e950f321680942cba, user_id=36b34abbbfa74c92bc49935c81c2170e, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:29.572206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abe2f0f-8224-4a8f-b753-09d92303c863 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:29.589029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 603/1192] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:05:29 2022] PUT /identity/v3/projects/657eceef7274491e950f321680942cba/users/36b34abbbfa74c92bc49935c81c2170e/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:05:31.533228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cf99d-3ddd-4667-83da-d89570a24ac6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:31.533817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cf99d-3ddd-4667-83da-d89570a24ac6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:31.533817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56cf99d-3ddd-4667-83da-d89570a24ac6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:31.535150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 590/1193] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:05:31.541612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ece115-d985-4421-9edb-fdd9aa2b4aac None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:31.542359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ece115-d985-4421-9edb-fdd9aa2b4aac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:31.542559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ece115-d985-4421-9edb-fdd9aa2b4aac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:31.573464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c7ece115-d985-4421-9edb-fdd9aa2b4aac None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:05:31.574697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c7ece115-d985-4421-9edb-fdd9aa2b4aac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:05:31.647543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 604/1194] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:05:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:05:31.684440 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cf99d-3ddd-4667-83da-d89570a24ac6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:31.797065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56cf99d-3ddd-4667-83da-d89570a24ac6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:31.826988 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:31.833858 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:31.834523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:31.834803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:31.835073 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:31.846669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:05:31.851367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:05:31.852584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:05:31.853705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 591/1195] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:05:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:05:31.859393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ece115-d985-4421-9edb-fdd9aa2b4aac None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:31.882113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:31.963918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ece115-d985-4421-9edb-fdd9aa2b4aac None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:31.999400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:31.999998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:32.000274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:32.000541 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:32.001203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:32.001502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:32.002910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:32.011037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 605/1196] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:05:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:05:32.017737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:32.131916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76b625d-4185-4616-8633-c482747f7da8 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:32.167217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:32.167840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:32.168113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:32.168388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] PATH_INFO: `/v3/users/36b34abbbfa74c92bc49935c81c2170e` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:32.169625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] RBAC: Authorizing `identity:get_user(user_id=36b34abbbfa74c92bc49935c81c2170e)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:32.171088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:32.172696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 592/1197] 10.222.0.39 () {56 vars in 1177 bytes} [Mon Aug 8 01:05:32 2022] GET /identity/v3/users/36b34abbbfa74c92bc49935c81c2170e => generated 311 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:32.179548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:32.273275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:32.294984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b74c46b-ca32-49ac-9eae-43702530658b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:32.341570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:32.342270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:32.342542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:32.342813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:32.416912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:32.418443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:32.502459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:32.522381 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 606/1198] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:05:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:05:32.528879 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:32.594196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:32.647930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e20bf76-99bd-4146-b3f0-0bf858acc186 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:32.682478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22abec0-856a-4647-b798-d791400f5933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:32.683021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22abec0-856a-4647-b798-d791400f5933 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:32.683288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22abec0-856a-4647-b798-d791400f5933 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:32.683556 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22abec0-856a-4647-b798-d791400f5933 None admin] PATH_INFO: `/v3/projects/657eceef7274491e950f321680942cba` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:32.685124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22abec0-856a-4647-b798-d791400f5933 None admin] RBAC: Authorizing `identity:get_project(project_id=657eceef7274491e950f321680942cba)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:32.686586 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22abec0-856a-4647-b798-d791400f5933 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:32.688190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 593/1199] 10.222.0.39 () {56 vars in 1186 bytes} [Mon Aug 8 01:05:32 2022] GET /identity/v3/projects/657eceef7274491e950f321680942cba => generated 361 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:32.698313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:05:32.804538 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373da7e-db7b-4038-8907-bc918cef126c None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:05:32.846482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c70ff78-f70c-4676-bd25-154742fa5df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:05:32.847411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ff78-f70c-4676-bd25-154742fa5df0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:05:32.847845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ff78-f70c-4676-bd25-154742fa5df0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:05:32.848262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c70ff78-f70c-4676-bd25-154742fa5df0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:05:32.849427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70ff78-f70c-4676-bd25-154742fa5df0 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=657eceef7274491e950f321680942cba, user.id=36b34abbbfa74c92bc49935c81c2170e) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:05:32.849816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70ff78-f70c-4676-bd25-154742fa5df0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:05:32.852115 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c70ff78-f70c-4676-bd25-154742fa5df0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:05:32.859074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 607/1200] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:05:32 2022] GET /identity/v3/role_assignments?user.id=36b34abbbfa74c92bc49935c81c2170e&scope.project.id=657eceef7274491e950f321680942cba&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:05:42.677314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=37 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:05:42.856049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=77 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:28.045656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc76e-cbe7-48d6-9d67-e3d8658aecb3 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:28.046317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc76e-cbe7-48d6-9d67-e3d8658aecb3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:28.046317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174cc76e-cbe7-48d6-9d67-e3d8658aecb3 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:28.047571 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 594/1201] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:28.057854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581b61-59ba-4f65-a5fb-f904de3dfa48 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:28.057854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581b61-59ba-4f65-a5fb-f904de3dfa48 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:28.057854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4581b61-59ba-4f65-a5fb-f904de3dfa48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:28.075973 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a4581b61-59ba-4f65-a5fb-f904de3dfa48 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:28.077244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a4581b61-59ba-4f65-a5fb-f904de3dfa48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:28.161194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 608/1202] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:06:28.186202 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cc76e-cbe7-48d6-9d67-e3d8658aecb3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:28.329028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174cc76e-cbe7-48d6-9d67-e3d8658aecb3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:28.369274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:28.369912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:28.373622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:28.373622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:28.386596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:28.388314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:28.412632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:28.414303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:28.420754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:28.420754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:28.420754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:28.420754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 595/1203] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:28.421007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4581b61-59ba-4f65-a5fb-f904de3dfa48 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:28.548950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4581b61-59ba-4f65-a5fb-f904de3dfa48 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:28.585162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:28.591909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5402ff6a-b4e4-47f9-9f89-3eacd07567f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:28.592524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ff6a-b4e4-47f9-9f89-3eacd07567f7 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:28.592843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ff6a-b4e4-47f9-9f89-3eacd07567f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:28.593078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5402ff6a-b4e4-47f9-9f89-3eacd07567f7 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:28.593722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ff6a-b4e4-47f9-9f89-3eacd07567f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:28.594004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ff6a-b4e4-47f9-9f89-3eacd07567f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:28.595406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5402ff6a-b4e4-47f9-9f89-3eacd07567f7 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:28.608061 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 609/1204] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:28.613832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:28.677413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:28.739307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a828c5be-49b5-4462-83ad-eb0d4a9abbb2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:28.783473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f084e592-334e-4bb5-9735-0d9ecb35f5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:28.784087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e592-334e-4bb5-9735-0d9ecb35f5c3 None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:28.784413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e592-334e-4bb5-9735-0d9ecb35f5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:28.784652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f084e592-334e-4bb5-9735-0d9ecb35f5c3 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:28.785273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084e592-334e-4bb5-9735-0d9ecb35f5c3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:28.786800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f084e592-334e-4bb5-9735-0d9ecb35f5c3 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:28.826085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 596/1205] 10.222.0.39 () {60 vars in 1132 bytes} [Mon Aug 8 01:06:28 2022] POST /identity/v3/users => generated 251 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:06:30.944739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf53889-97d4-446e-b80f-1f4271dbdb52 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:30.945330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf53889-97d4-446e-b80f-1f4271dbdb52 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:30.945330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf53889-97d4-446e-b80f-1f4271dbdb52 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:30.946662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 610/1206] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:30.951982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa436-f139-47bc-9629-fce567dc7b2a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:30.952429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa436-f139-47bc-9629-fce567dc7b2a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:30.952519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37caa436-f139-47bc-9629-fce567dc7b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:30.971077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-37caa436-f139-47bc-9629-fce567dc7b2a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:30.972324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-37caa436-f139-47bc-9629-fce567dc7b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:31.056716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 597/1207] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:06:31.083726 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf53889-97d4-446e-b80f-1f4271dbdb52 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:31.215697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf53889-97d4-446e-b80f-1f4271dbdb52 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:31.262753 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:31.263454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:31.263748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:31.264053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:31.278851 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:06:31.284526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:31.285586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:06:31.286532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:31.291759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 611/1208] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:06:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:06:31.294082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa436-f139-47bc-9629-fce567dc7b2a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:31.342602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:31.415203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37caa436-f139-47bc-9629-fce567dc7b2a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:31.464554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:31.465358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:31.465668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:31.466039 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:31.466949 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:31.467350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:31.469103 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:31.479852 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 598/1209] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:06:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:31.487063 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:31.550159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:31.614063 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952ca16e-1fe2-463d-b7e0-5342c6c550ad None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:31.652814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:31.653655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:31.653945 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:31.654413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:31.666798 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:31.668278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:31.683011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:31.684060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:31.685057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:31.685057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:31.685057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:31.685057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 612/1210] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:06:31.691564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:31.803851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:31.807312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fdd9a4-33df-4a8f-99a8-467be7d22054 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:31.844641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:31.845471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:31.845639 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:31.845769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:31.846501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:31.846812 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:31.848190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:31.864452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 599/1211] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:06:31.870115 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:31.983084 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598144f-0838-40c3-b7a6-6767ba75328b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:31.984917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:32.022293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:32.022935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:32.023248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:32.023529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:32.032958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:32.034483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:06:32.047179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:32.048404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:32.049382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 613/1212] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:32.056948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:32.173007 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae42089c-f53e-43ec-83c8-6180b597faca None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:32.213553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:32.214461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:32.214785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:32.215057 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:32.215796 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:32.216130 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:32.217894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:32.237590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 600/1213] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Aug 8 01:06:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:32.245245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:32.373864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaed10c-445a-4d84-b1bf-bd1532eaafcb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:32.413377 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:32.414014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:32.414320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:32.414607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:32.449999 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:32.496117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:32.498380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:32.626295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 614/1214] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:06:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:06:32.634029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:32.657954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:32.748973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bc0006-884e-4a5d-8946-8ead4a8d0ce1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:32.788011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:32.789636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:32.789636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:32.789636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:32.801458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:32.803107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:32.825674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:32.827469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:32.828595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:32.828595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:32.828595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:32.831926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 601/1215] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:32.834187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:32.904459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:32.950791 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226694bb-5430-4d9d-9769-408f2e0e61b4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:32.988277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:32.989082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:32.989428 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:32.989740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:32.990552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:32.991043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:32.992517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:33.006080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 615/1216] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:33.011827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:33.090682 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:33.126673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d884b1b6-8c18-4513-abad-19b400590f28 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:33.168029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:33.168687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:33.168964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:33.169236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:33.177148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:33.179003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:06:33.191508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:33.192501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:33.193409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 602/1217] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:06:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:33.199483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:33.323613 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b39ef6a-d780-4083-a421-dd2996b313e1 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:33.348921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:33.362508 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed55c350-216a-4e40-b09f-6930ccbec209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:33.363117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55c350-216a-4e40-b09f-6930ccbec209 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:33.363393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55c350-216a-4e40-b09f-6930ccbec209 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:33.363692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed55c350-216a-4e40-b09f-6930ccbec209 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:33.364365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55c350-216a-4e40-b09f-6930ccbec209 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:33.364708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55c350-216a-4e40-b09f-6930ccbec209 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:33.367026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed55c350-216a-4e40-b09f-6930ccbec209 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:33.379503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 616/1218] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:06:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:33.386414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:33.510634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2a7832-fded-4e3b-8d72-ef9c782275f7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:33.542248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:33.548908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfe3f36-d7d2-46de-98ea-69534c67c00c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:33.549594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3f36-d7d2-46de-98ea-69534c67c00c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:33.549938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3f36-d7d2-46de-98ea-69534c67c00c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:33.550273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfe3f36-d7d2-46de-98ea-69534c67c00c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:33.553085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe3f36-d7d2-46de-98ea-69534c67c00c None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=14eeba99731f4c0f98ea78914f8ed697) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:33.553085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe3f36-d7d2-46de-98ea-69534c67c00c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:33.553085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfe3f36-d7d2-46de-98ea-69534c67c00c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:33.562082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 603/1219] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:06:33 2022] GET /identity/v3/role_assignments?user.id=14eeba99731f4c0f98ea78914f8ed697&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:35.639587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6328-1fed-4158-a489-ddf7c1004c59 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:35.640162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6328-1fed-4158-a489-ddf7c1004c59 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:35.640162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed6328-1fed-4158-a489-ddf7c1004c59 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:35.641477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 617/1220] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:06:35.647306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743271ed-b8f5-48f3-a8ab-a207ff76a495 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:35.647806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743271ed-b8f5-48f3-a8ab-a207ff76a495 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:35.647806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743271ed-b8f5-48f3-a8ab-a207ff76a495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:35.666867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-743271ed-b8f5-48f3-a8ab-a207ff76a495 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:35.668081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-743271ed-b8f5-48f3-a8ab-a207ff76a495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:35.736240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 604/1221] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:06:35.759513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6328-1fed-4158-a489-ddf7c1004c59 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:35.877279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed6328-1fed-4158-a489-ddf7c1004c59 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:35.915943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:35.916482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:35.916759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:35.917025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:35.928352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:06:35.933739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:35.934950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:35.936222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 618/1222] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:06:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:35.941158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743271ed-b8f5-48f3-a8ab-a207ff76a495 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:36.045487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743271ed-b8f5-48f3-a8ab-a207ff76a495 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:36.072737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:36.089127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:36.089803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:36.090151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:36.090493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:36.091274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] RBAC: Adding query filter params (name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:36.091612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:36.093016 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:36.101574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 605/1223] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:06:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:36.108348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:36.156360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:36.224216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0687c3-b0ea-425e-8621-843b5afa9480 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:36.262164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:36.262928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:36.263207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:36.263520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:36.275752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:36.277441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:36.292443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:36.293567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:36.294581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:36.294581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:36.294581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:36.294581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 619/1224] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:06:36.299524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:36.404996 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690a1902-ccbb-4fe4-b2c2-7755383db848 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:36.442758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:36.443366 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:36.443758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:36.444027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:36.444723 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:36.445054 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:36.446555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:36.460627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 606/1225] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:36.467211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:36.574035 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:36.580840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e91315-ac97-4f3b-b611-d60244bc62e4 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:36.616717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:36.617352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:36.617626 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:36.617899 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:36.625932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:36.627417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:06:36.639336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:36.641051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:36.642185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 620/1226] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:36.646532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:36.696156 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:36.749083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b941c3-e2de-42e3-8a5f-f5f8f6607dff None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:36.788871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:36.789736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:36.790006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:36.790307 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:36.791151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:36.791484 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:36.793375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:36.815078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 607/1227] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Aug 8 01:06:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:36.821304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:36.932274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db303735-41ac-4402-8ecb-815b042f6d63 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:36.966743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:36.967432 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:36.967734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:36.967997 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:36.978969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:36.980414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:36.995486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:36.996641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:36.997553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:36.997553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:36.997553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:36.997553 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 621/1228] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:37.002689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:37.105265 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdd9cf0-33b6-4041-b1b8-3c7be3a47360 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:37.109683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:37.143407 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:37.144074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:37.144352 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:37.144621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:37.145272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:37.145570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:37.147064 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:37.158759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 608/1229] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:37.165189 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:37.174829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:37.270579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863ccc09-0459-416b-bf6c-7813f7f070a2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:37.307003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:37.307816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:37.308093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:37.308360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:37.315021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:37.316470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:06:37.328274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:37.329304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:37.336003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 622/1230] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:06:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:37.336530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:37.440911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b37788-04b2-4805-9810-32b016cabc36 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:37.473596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59da7923-eb46-45af-b64c-8dacb0a1e130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:37.474235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7923-eb46-45af-b64c-8dacb0a1e130 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:37.474506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7923-eb46-45af-b64c-8dacb0a1e130 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:37.475006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59da7923-eb46-45af-b64c-8dacb0a1e130 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:37.475863 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7923-eb46-45af-b64c-8dacb0a1e130 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:37.476163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7923-eb46-45af-b64c-8dacb0a1e130 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:37.477609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59da7923-eb46-45af-b64c-8dacb0a1e130 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:37.489834 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 609/1231] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:06:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:37.496034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:37.568140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:37.605013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31797b2-d4bd-49ae-9598-e7ed7fc2348b None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:37.642293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b600415-3e8c-4fd4-8c85-ebb10598c24f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:37.643052 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600415-3e8c-4fd4-8c85-ebb10598c24f None admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:37.643303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600415-3e8c-4fd4-8c85-ebb10598c24f None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:37.643555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600415-3e8c-4fd4-8c85-ebb10598c24f None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/14eeba99731f4c0f98ea78914f8ed697/roles/425493bbc4074fcf99b58b8a87915b6a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:37.660278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b600415-3e8c-4fd4-8c85-ebb10598c24f None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=14eeba99731f4c0f98ea78914f8ed697, role_id=425493bbc4074fcf99b58b8a87915b6a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:37.661685 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b600415-3e8c-4fd4-8c85-ebb10598c24f None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:37.674961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 623/1232] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:06:37 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/14eeba99731f4c0f98ea78914f8ed697/roles/425493bbc4074fcf99b58b8a87915b6a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:06:39.809045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7339d-5b29-4d68-8226-8beeb974e9cf None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:39.809638 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7339d-5b29-4d68-8226-8beeb974e9cf None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:39.809638 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7339d-5b29-4d68-8226-8beeb974e9cf None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:39.810978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 610/1233] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:39.816367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9d6e-ea3c-49e7-a936-cc05a3e7bd96 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:39.816866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9d6e-ea3c-49e7-a936-cc05a3e7bd96 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:39.816985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f9d6e-ea3c-49e7-a936-cc05a3e7bd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:39.835094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a49f9d6e-ea3c-49e7-a936-cc05a3e7bd96 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:39.836281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a49f9d6e-ea3c-49e7-a936-cc05a3e7bd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:39.911845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 624/1234] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:06:39.938810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7339d-5b29-4d68-8226-8beeb974e9cf None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:39.967584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:40.050792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7339d-5b29-4d68-8226-8beeb974e9cf None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:40.096394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:40.097108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:40.097445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:40.097906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:40.109512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:06:40.114274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:40.115643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:40.116498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 611/1235] 10.222.0.39 () {56 vars in 1102 bytes} [Mon Aug 8 01:06:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:40.122608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f9d6e-ea3c-49e7-a936-cc05a3e7bd96 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:40.170537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:40.229275 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f9d6e-ea3c-49e7-a936-cc05a3e7bd96 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:40.266222 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:40.266959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:40.267409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:40.267876 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:40.268785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] RBAC: Adding query filter params (name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:40.269150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:40.270697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:40.282638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 625/1236] 10.222.0.39 () {56 vars in 1103 bytes} [Mon Aug 8 01:06:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:40.288828 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:40.386697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:40.403440 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551a4a0-d509-41be-9501-e24ccc80bfb7 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:40.441180 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:40.441834 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:40.442145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:40.442421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:40.453328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:40.454815 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:40.471619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:40.472820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:40.473726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:40.473726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:40.473726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:40.473726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 612/1237] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:40.479182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:40.597956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376c583e-4f76-47e2-9e3c-ca73a285ba4e None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:40.610356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:40.638886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:40.639509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:40.639743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:40.640046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:40.640845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:40.641181 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:40.642822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:40.656438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 626/1238] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:06:40.662692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:40.769145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90c46a6-12c7-483a-9f1c-6ac3a8200445 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:40.805256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:40.805871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:40.806173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:40.806442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:40.809171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:40.815563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:40.817153 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:06:40.829286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:40.830539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:40.831827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 613/1239] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:40.836828 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:40.943641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe21de8f-9125-4893-8378-b95b8baf9143 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:40.980837 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:40.981466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:40.981813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:40.982115 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:40.982883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:40.983170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:40.984840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:41.004578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 627/1240] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Aug 8 01:06:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:41.011086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:41.116564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c53c927-af43-4032-8190-6188252bfb3c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:41.153965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:41.154672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:41.154960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:41.155242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:41.220700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:41.227641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:41.229082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:41.327657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 614/1241] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:06:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 08 01:06:41.332090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:41.363351 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:41.439596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bf9a1e-dedd-49b9-af52-8d717eb4f792 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:41.473882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:41.474494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:41.474766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:41.475030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:41.485448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:41.486923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:41.502158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:41.503492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:41.504699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:41.504699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:41.504699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:41.504699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 628/1242] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:41.509323 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:41.608176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:41.615569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ef1e066-0050-4af7-bcea-aeb5d2c19a3b None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:41.654226 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:41.654899 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:41.655215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:41.655488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:41.656144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:41.656436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:41.657801 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:41.669768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 615/1243] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:41.675991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:41.765233 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:41.787743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d144cdb-b1ea-42a7-b792-4e42ab2cdcd9 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:41.828214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:41.828896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:41.829176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:41.829466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:41.838210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:41.840669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:06:41.856004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:41.857158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:41.859346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 629/1244] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:06:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:41.863636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:41.991453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251ba51-a036-4126-a3db-5fce7b54906f None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:42.032184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd38c5e-1a4a-430e-b0d2-fa7b33319675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:42.032726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38c5e-1a4a-430e-b0d2-fa7b33319675 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:42.033014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38c5e-1a4a-430e-b0d2-fa7b33319675 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:42.033285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd38c5e-1a4a-430e-b0d2-fa7b33319675 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:42.033979 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38c5e-1a4a-430e-b0d2-fa7b33319675 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:42.034315 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38c5e-1a4a-430e-b0d2-fa7b33319675 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:42.035794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd38c5e-1a4a-430e-b0d2-fa7b33319675 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:42.048813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 616/1245] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:06:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:06:42.056293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:42.168499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543cf07d-ab58-4483-8607-47f725b6bc92 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:42.202188 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97555198-e366-4480-9b40-848332e63cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:42.202808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555198-e366-4480-9b40-848332e63cac None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:42.203098 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555198-e366-4480-9b40-848332e63cac None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:42.203469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97555198-e366-4480-9b40-848332e63cac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:42.204281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555198-e366-4480-9b40-848332e63cac None admin] RBAC: Adding query filter params (role.id=425493bbc4074fcf99b58b8a87915b6a, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=14eeba99731f4c0f98ea78914f8ed697) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:42.204482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555198-e366-4480-9b40-848332e63cac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:42.205922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97555198-e366-4480-9b40-848332e63cac None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:42.212152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 630/1246] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:06:42 2022] GET /identity/v3/role_assignments?user.id=14eeba99731f4c0f98ea78914f8ed697&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=425493bbc4074fcf99b58b8a87915b6a => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:44.263767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e2db8-3c4f-4686-922b-191a0bc41ef2 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:44.264367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e2db8-3c4f-4686-922b-191a0bc41ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:44.264367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e2db8-3c4f-4686-922b-191a0bc41ef2 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:44.265796 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 617/1247] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:44.271513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f514ed-7c72-488f-8212-1c1964ec9911 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:44.271954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f514ed-7c72-488f-8212-1c1964ec9911 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:44.272173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f514ed-7c72-488f-8212-1c1964ec9911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:44.278665 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:44.292906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-44f514ed-7c72-488f-8212-1c1964ec9911 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:44.294134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-44f514ed-7c72-488f-8212-1c1964ec9911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:44.377559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 631/1248] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 08 01:06:44.402596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e2db8-3c4f-4686-922b-191a0bc41ef2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:44.422794 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:44.520178 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e2db8-3c4f-4686-922b-191a0bc41ef2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:44.560345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:44.561070 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:44.561364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:44.561626 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:44.574360 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:06:44.579652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:44.580750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:44.581619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 618/1249] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:44.587359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f514ed-7c72-488f-8212-1c1964ec9911 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:44.698122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f514ed-7c72-488f-8212-1c1964ec9911 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:44.730775 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:44.736490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:44.737193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:44.737475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:44.737781 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:44.738480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:44.738782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:44.740387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:44.749206 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 632/1250] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:44.757050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:44.854270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:44.884369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d1b19-9efd-4069-84de-d8fe29621ae2 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:44.924824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:44.925462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:44.925740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:44.926014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:44.938234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:44.939907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:44.956447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:44.957743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:44.958781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:44.958781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:44.958781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:44.958781 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 619/1251] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:44.964148 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:45.075864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695cb37-6cfe-4309-a916-84ab68a079c0 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:45.112583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810d26-62db-4027-8196-cac674418bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:45.113200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810d26-62db-4027-8196-cac674418bcc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:45.113478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810d26-62db-4027-8196-cac674418bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:45.113748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66810d26-62db-4027-8196-cac674418bcc None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:45.114491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810d26-62db-4027-8196-cac674418bcc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:45.114987 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810d26-62db-4027-8196-cac674418bcc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:45.116566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66810d26-62db-4027-8196-cac674418bcc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:45.131284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 633/1252] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:45.137308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:45.247331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bc553a-91f2-4947-ad44-e709109b5e83 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:45.273856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:45.282549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:45.283226 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:45.283504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:45.283790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:45.292932 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:45.294589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:06:45.308446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:45.309587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:45.315450 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 620/1253] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:45.316179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810d26-62db-4027-8196-cac674418bcc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:45.383357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:45.434706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66810d26-62db-4027-8196-cac674418bcc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:45.474405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:45.475014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:45.475287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:45.475549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:45.476287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:45.476582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:45.478200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:45.497420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 634/1254] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Aug 8 01:06:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:45.504043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:45.619445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8340c51e-92f6-4049-b1c3-7b32f3060b6c None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:45.655715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:45.656302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:45.656576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:45.656842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:45.723440 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:45.740411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:45.741866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:45.855020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 621/1255] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:06:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:06:45.861581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:45.989046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cb5d3-08ba-46b6-a55b-0ca86992d0a3 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:46.003613 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:46.029048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:46.029702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:46.029981 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:46.030284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:46.042111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:46.043588 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:46.060489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:46.061761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:46.062880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:46.062880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:46.062880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:46.062880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 635/1256] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:46.068546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:46.169228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:46.182891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bee548-845b-4c1a-9b9d-458e57128642 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:46.220108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:46.220739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:46.221018 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:46.221285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:46.222112 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:46.222417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:46.223894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:46.236058 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 622/1257] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:46.242505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:46.355048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e504ce-6091-4738-bdb7-0005f507ea4d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:46.390871 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:46.391534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:46.391809 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:46.392077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:46.399963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:46.401450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:06:46.415977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:46.417114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:46.418268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 636/1258] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:06:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:46.424747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:46.538086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e65c0c7-9142-45d4-b5ce-0fefcb0f5d18 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:46.580919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7084045e-29d1-48dc-96ee-6156dbc37877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:46.581584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084045e-29d1-48dc-96ee-6156dbc37877 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:46.581862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084045e-29d1-48dc-96ee-6156dbc37877 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:46.582166 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7084045e-29d1-48dc-96ee-6156dbc37877 None admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:46.582862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084045e-29d1-48dc-96ee-6156dbc37877 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:46.583348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084045e-29d1-48dc-96ee-6156dbc37877 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:46.585751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7084045e-29d1-48dc-96ee-6156dbc37877 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:46.601901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 623/1259] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:06:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:46.608789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:46.638994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:46.730279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1cd259-b825-42bd-8b8b-be36341b68f2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:46.771282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47586e8b-a2ca-4bd9-89d4-2272ed28f515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:46.771924 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47586e8b-a2ca-4bd9-89d4-2272ed28f515 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:46.772227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47586e8b-a2ca-4bd9-89d4-2272ed28f515 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:46.772469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47586e8b-a2ca-4bd9-89d4-2272ed28f515 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:46.773221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47586e8b-a2ca-4bd9-89d4-2272ed28f515 None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=14eeba99731f4c0f98ea78914f8ed697) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:46.773526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47586e8b-a2ca-4bd9-89d4-2272ed28f515 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:46.775047 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47586e8b-a2ca-4bd9-89d4-2272ed28f515 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:46.781209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 637/1260] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:06:46 2022] GET /identity/v3/role_assignments?user.id=14eeba99731f4c0f98ea78914f8ed697&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:06:48.836423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822c487-9463-4f0d-8c91-a302c1047763 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:48.837027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822c487-9463-4f0d-8c91-a302c1047763 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:48.837027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822c487-9463-4f0d-8c91-a302c1047763 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:48.838374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 624/1261] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:48.844486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd2b65-45d4-4cb4-a11f-01f9553d4211 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:48.845106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd2b65-45d4-4cb4-a11f-01f9553d4211 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:48.845207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd2b65-45d4-4cb4-a11f-01f9553d4211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:48.870463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-24dd2b65-45d4-4cb4-a11f-01f9553d4211 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:48.871715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-24dd2b65-45d4-4cb4-a11f-01f9553d4211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:48.949159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 638/1262] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:06:48.972646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822c487-9463-4f0d-8c91-a302c1047763 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:48.988025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:49.089457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822c487-9463-4f0d-8c91-a302c1047763 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:49.129169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:49.130020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:49.130177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:49.130387 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:49.141443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:06:49.146428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:49.147509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:49.149004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 625/1263] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:49.153985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd2b65-45d4-4cb4-a11f-01f9553d4211 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:49.173325 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:49.260120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24dd2b65-45d4-4cb4-a11f-01f9553d4211 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:49.295679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:49.296328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:49.296601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:49.296870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:49.297534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] RBAC: Adding query filter params (name=admin) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:49.297817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:49.299233 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:49.309298 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 639/1264] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:06:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:49.315584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:49.384411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:49.417745 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d352baae-14c2-472b-b321-4f949f009cf1 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:49.452328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:49.452983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:49.453263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:49.453532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:49.464461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:49.465904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:49.480448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:49.481615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:49.482862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:49.482862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:49.482862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:49.482862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 626/1265] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:49.488209 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:49.572855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:49.599307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7932121-16ec-4f51-862d-c34bb4c41eef None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:49.637520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:49.638083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:49.638359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:49.638628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:49.639273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:49.639572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:49.640954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:49.652695 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 640/1266] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:49.661376 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:49.768458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36633792-8ba9-436b-b408-03ea2fcbc23d None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:49.788532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:49.805891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:49.806563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:49.806840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:49.807110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:49.814773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:49.816207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:06:49.827290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:49.828364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:49.829739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 627/1267] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:49 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 08 01:06:49.834438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:49.951214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f27073-9588-46f5-9ac3-72d144682e10 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:49.989513 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:49.990116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:49.990431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:49.990684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:49.991406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:49.991708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:49.993153 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:50.003051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:50.016849 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 641/1268] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Aug 8 01:06:49 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:50.023148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:50.134252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed036ff-02f5-485f-a908-f0c2baa46d24 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:50.168029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:50.168647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:50.168918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:50.169183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:50.180292 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:50.181792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:50.195646 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:50.196719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:50.197634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:50.197634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:50.197634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:50.197634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 628/1269] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:50.203547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:50.314004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b7662f-6746-4897-9dba-9b9e1b974e2d None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:50.348535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:50.349320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:50.349593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:50.349859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:50.350532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:50.350826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:50.352190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:50.363531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 642/1270] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:50.370115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:50.413404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:50.489929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2997817d-5dfb-4339-86b2-57278ad571c5 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:50.525076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:50.525687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:50.525960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:50.526253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:50.533204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:50.534668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:06:50.546102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:50.547208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:50.548506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 629/1271] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:06:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:50.553639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:50.615545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:50.661453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa7ee39-040b-489f-92d4-eaf74d370fbc None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:50.701640 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dea8c0e-1f8f-4215-8520-4a8ef0f414e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:50.702264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8c0e-1f8f-4215-8520-4a8ef0f414e0 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:50.702542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8c0e-1f8f-4215-8520-4a8ef0f414e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:50.702809 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dea8c0e-1f8f-4215-8520-4a8ef0f414e0 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:50.703502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8c0e-1f8f-4215-8520-4a8ef0f414e0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:50.703803 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8c0e-1f8f-4215-8520-4a8ef0f414e0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:50.705257 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dea8c0e-1f8f-4215-8520-4a8ef0f414e0 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:50.717377 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 643/1272] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:06:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:50.723647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:50.822473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:50.832800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1621f0-b785-48aa-8695-8a97a310e27e None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:50.871280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c1254-28a8-4f64-8d07-bb1aa399ca19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:50.872099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1254-28a8-4f64-8d07-bb1aa399ca19 None admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:50.872389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1254-28a8-4f64-8d07-bb1aa399ca19 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:50.872669 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c1254-28a8-4f64-8d07-bb1aa399ca19 None admin] PATH_INFO: `/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/14eeba99731f4c0f98ea78914f8ed697/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:50.875096 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1254-28a8-4f64-8d07-bb1aa399ca19 None admin] RBAC: Authorizing `identity:create_grant(project_id=527237e81fd44bf6b40ec462a0d6b829, user_id=14eeba99731f4c0f98ea78914f8ed697, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:50.876840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942c1254-28a8-4f64-8d07-bb1aa399ca19 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:50.892184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 630/1273] 10.222.0.39 () {58 vars in 1439 bytes} [Mon Aug 8 01:06:50 2022] PUT /identity/v3/projects/527237e81fd44bf6b40ec462a0d6b829/users/14eeba99731f4c0f98ea78914f8ed697/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:06:52.854392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c6bd-2cb7-4573-8487-9b1528486eef None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:52.855341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c6bd-2cb7-4573-8487-9b1528486eef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:52.855341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421c6bd-2cb7-4573-8487-9b1528486eef None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:52.857375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 644/1274] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:52.863948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe6bf-1854-4038-b36e-533f572f75dc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:52.864400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe6bf-1854-4038-b36e-533f572f75dc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:52.864521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfe6bf-1854-4038-b36e-533f572f75dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:52.884927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8acfe6bf-1854-4038-b36e-533f572f75dc None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:52.886235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8acfe6bf-1854-4038-b36e-533f572f75dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:52.959940 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 631/1275] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:06:52.988739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421c6bd-2cb7-4573-8487-9b1528486eef None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:53.100915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421c6bd-2cb7-4573-8487-9b1528486eef None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:53.118679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:53.135716 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:53.136345 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:53.136620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:53.136887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:53.146719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 08 01:06:53.151383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:53.152434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:53.153417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 645/1276] 10.222.0.39 () {56 vars in 1096 bytes} [Mon Aug 8 01:06:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:53.158752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe6bf-1854-4038-b36e-533f572f75dc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:53.247589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:53.269354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acfe6bf-1854-4038-b36e-533f572f75dc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:53.304906 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:53.305497 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:53.305773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:53.306026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:53.306721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] RBAC: Adding query filter params (name=admin) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:53.307013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:53.308362 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:53.316133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 632/1277] 10.222.0.39 () {56 vars in 1099 bytes} [Mon Aug 8 01:06:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:53.322623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:53.430366 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31db4d56-0964-4757-8963-055797ef1719 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:53.465046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:53.465655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:53.465927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:53.466223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:53.476364 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:53.477795 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:53.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:53.493454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:53.495316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:53.495316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:53.495316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:53.495316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 646/1278] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:53.501853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:53.607888 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73cfe54-3ace-4421-bc90-ef7de93b6fab None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:53.641974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:53.642595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:53.642865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:53.643109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:53.643740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:53.644032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:53.645523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:53.656892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 633/1279] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:53.663478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:53.711238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:53.793638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc8b2e8-316a-41e8-9dfd-d69f134701e2 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:53.831262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:53.831872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:53.832147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:53.832441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:53.845955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:53.848464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 08 01:06:53.866517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:53.868449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:53.869812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 647/1280] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:53.875088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:53.879933 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:53.994635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25332db0-2114-4262-b9cf-d43b21583817 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:54.029694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:54.030320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:54.030629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:54.030877 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:54.031605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:54.031904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:54.033320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:54.050683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 634/1281] 10.222.0.39 () {56 vars in 1143 bytes} [Mon Aug 8 01:06:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:54.058002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:54.164603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:54.176992 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82d5173d-9207-43f5-a5c7-1f7963f65c41 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:54.216252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:54.216855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:54.217136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:54.217404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:54.294673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:54.296844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:54.389625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:54.400363 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 648/1282] 10.222.0.39 () {58 vars in 1282 bytes} [Mon Aug 8 01:06:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 08 01:06:54.406457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:54.472363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:54.513218 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8e0ce2-e173-4c6d-af32-c82bcdcf1433 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:54.550509 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:54.551140 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:54.551420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:54.551684 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:54.563432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:54.564865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 08 01:06:54.581022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:54.582125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 08 01:06:54.583582 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 08 01:06:54.583582 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 08 01:06:54.583582 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:54.583582 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 635/1283] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:54.588161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:54.693910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9920fb9-ba7c-4e84-92a9-4ad6199c9df6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:54.734270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:54.735130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:54.735485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:54.735852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:54.736836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:54.737255 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:54.739425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:54.756295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 649/1284] 10.222.0.39 () {56 vars in 1109 bytes} [Mon Aug 8 01:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:54.764805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:54.873729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200a13f4-0159-4b83-8736-3040c666d778 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:54.886981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:54.908108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:54.908737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:54.909014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:54.909282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:54.916129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:54.917570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 08 01:06:54.929176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:54.930227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: ERROR keystone.server.flask.application Aug 08 01:06:54.931740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 636/1285] 10.222.0.39 () {56 vars in 1111 bytes} [Mon Aug 8 01:06:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:54.939805 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:54.997675 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:55.055555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b8367-3a96-4f17-a766-146c2a3d9ccb None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:55.094973 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711d7b19-a05f-47c2-98a7-967f35800e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:55.095574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7b19-a05f-47c2-98a7-967f35800e82 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:55.095853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7b19-a05f-47c2-98a7-967f35800e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:55.096131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711d7b19-a05f-47c2-98a7-967f35800e82 None admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:55.096827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7b19-a05f-47c2-98a7-967f35800e82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:55.097127 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7b19-a05f-47c2-98a7-967f35800e82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:55.098821 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711d7b19-a05f-47c2-98a7-967f35800e82 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:55.111642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 650/1286] 10.222.0.39 () {56 vars in 1148 bytes} [Mon Aug 8 01:06:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:55.117858 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:55.229109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7187a6-cc0c-4c18-a9be-1a1adc686ba9 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:55.263482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8775f4e6-cbc0-42dd-b176-e8dc55d2daff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:55.264077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775f4e6-cbc0-42dd-b176-e8dc55d2daff None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:55.264347 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775f4e6-cbc0-42dd-b176-e8dc55d2daff None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:55.264617 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8775f4e6-cbc0-42dd-b176-e8dc55d2daff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:55.265326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775f4e6-cbc0-42dd-b176-e8dc55d2daff None admin] RBAC: Adding query filter params (role.id=c1d69d4e205e4dd2a70bde18f8382f38, scope.project.id=527237e81fd44bf6b40ec462a0d6b829, user.id=14eeba99731f4c0f98ea78914f8ed697) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:55.265638 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775f4e6-cbc0-42dd-b176-e8dc55d2daff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:55.267073 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8775f4e6-cbc0-42dd-b176-e8dc55d2daff None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:55.273233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 637/1287] 10.222.0.39 () {56 vars in 1374 bytes} [Mon Aug 8 01:06:55 2022] GET /identity/v3/role_assignments?user.id=14eeba99731f4c0f98ea78914f8ed697&scope.project.id=527237e81fd44bf6b40ec462a0d6b829&role.id=c1d69d4e205e4dd2a70bde18f8382f38 => generated 608 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:06:57.287628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ccde-caca-45eb-98f3-18bbcd803627 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:57.288260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ccde-caca-45eb-98f3-18bbcd803627 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:57.288260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4531ccde-caca-45eb-98f3-18bbcd803627 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:57.290032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 651/1288] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:57.297358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95dc42-1ef0-4332-89b9-bfc3124c3c82 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:57.298127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95dc42-1ef0-4332-89b9-bfc3124c3c82 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:57.298285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf95dc42-1ef0-4332-89b9-bfc3124c3c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:57.319522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bf95dc42-1ef0-4332-89b9-bfc3124c3c82 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:57.320713 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bf95dc42-1ef0-4332-89b9-bfc3124c3c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:57.353809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:57.398471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 638/1289] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:06:57.426424 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531ccde-caca-45eb-98f3-18bbcd803627 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:57.543794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4531ccde-caca-45eb-98f3-18bbcd803627 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:57.554638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:57.583654 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:57.584284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:57.584558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:57.584824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:57.585406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:57.586829 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:06:57.595926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:06:57.597138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:06:57.598526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 652/1290] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:06:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:06:57.603461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95dc42-1ef0-4332-89b9-bfc3124c3c82 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:57.711967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf95dc42-1ef0-4332-89b9-bfc3124c3c82 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:57.747099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1edbd-60f6-4c45-8cd3-8b0274fcd01e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:57.747694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1edbd-60f6-4c45-8cd3-8b0274fcd01e None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:57.747971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1edbd-60f6-4c45-8cd3-8b0274fcd01e None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:57.748242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1edbd-60f6-4c45-8cd3-8b0274fcd01e None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:57.748865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1edbd-60f6-4c45-8cd3-8b0274fcd01e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:57.749171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1edbd-60f6-4c45-8cd3-8b0274fcd01e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:57.750559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1edbd-60f6-4c45-8cd3-8b0274fcd01e None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:57.755513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 639/1291] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Aug 8 01:06:57 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:06:57.763951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:06:57.879942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6a58c-3391-43a3-b6cc-94a594c343b6 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:06:57.920895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66564dab-35aa-4ac1-9d57-7d6110dbc982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:06:57.921567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66564dab-35aa-4ac1-9d57-7d6110dbc982 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:57.921852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66564dab-35aa-4ac1-9d57-7d6110dbc982 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:57.922174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66564dab-35aa-4ac1-9d57-7d6110dbc982 None admin] PATH_INFO: `/v3/services` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:57.922890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66564dab-35aa-4ac1-9d57-7d6110dbc982 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:06:57.923189 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66564dab-35aa-4ac1-9d57-7d6110dbc982 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:06:57.924573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66564dab-35aa-4ac1-9d57-7d6110dbc982 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:06:57.929487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 653/1292] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Aug 8 01:06:57 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:06:59.865759 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e472a-ee05-41ff-a39a-c1d100d78d8b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:59.866381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e472a-ee05-41ff-a39a-c1d100d78d8b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:59.866381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833e472a-ee05-41ff-a39a-c1d100d78d8b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:59.867655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 640/1293] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:06:59.873771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b732fb6-cb30-4224-9b6e-2b11d106a32c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:06:59.874545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b732fb6-cb30-4224-9b6e-2b11d106a32c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:06:59.874649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b732fb6-cb30-4224-9b6e-2b11d106a32c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:06:59.895743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6b732fb6-cb30-4224-9b6e-2b11d106a32c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:06:59.896946 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6b732fb6-cb30-4224-9b6e-2b11d106a32c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:06:59.930161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:06:59.969717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 654/1294] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:06:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:06:59.992783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e472a-ee05-41ff-a39a-c1d100d78d8b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:00.032917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:07:00.109919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833e472a-ee05-41ff-a39a-c1d100d78d8b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:00.145883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3c9ee2-53f8-47b1-ad16-92eaa342808f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:00.146512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9ee2-53f8-47b1-ad16-92eaa342808f None admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:00.146785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9ee2-53f8-47b1-ad16-92eaa342808f None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:00.147048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3c9ee2-53f8-47b1-ad16-92eaa342808f None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:00.147682 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c9ee2-53f8-47b1-ad16-92eaa342808f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:00.149030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3c9ee2-53f8-47b1-ad16-92eaa342808f None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:00.167868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 641/1295] 10.222.0.39 () {60 vars in 1141 bytes} [Mon Aug 8 01:06:59 2022] POST /identity/v3/services => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:07:02.173090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac029f2-ac56-40b9-8e04-d80ef4d15260 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:02.173647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac029f2-ac56-40b9-8e04-d80ef4d15260 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:02.173647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac029f2-ac56-40b9-8e04-d80ef4d15260 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:02.176638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 655/1296] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:07:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:07:02.185793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1673a9-6d4b-494b-bdfc-16b9d854adf9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:02.186231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1673a9-6d4b-494b-bdfc-16b9d854adf9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:02.186394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1673a9-6d4b-494b-bdfc-16b9d854adf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:02.206976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2b1673a9-6d4b-494b-bdfc-16b9d854adf9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:07:02.208158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2b1673a9-6d4b-494b-bdfc-16b9d854adf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:07:02.288867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 642/1297] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:07:02 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:07:02.316113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac029f2-ac56-40b9-8e04-d80ef4d15260 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:02.433405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac029f2-ac56-40b9-8e04-d80ef4d15260 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:02.479298 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:02.479934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:02.480211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:02.480482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:02.481064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:02.482473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:07:02.491861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:07:02.493011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:07:02.494307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 656/1298] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:07:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:07:02.500719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1673a9-6d4b-494b-bdfc-16b9d854adf9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:02.520065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:07:02.603083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1673a9-6d4b-494b-bdfc-16b9d854adf9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:02.642153 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:02.642758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:02.643031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:02.643297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:02.643919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:07:02.644327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:02.645793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:02.650828 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 643/1299] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Aug 8 01:07:02 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:07:02.660380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:02.703806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:07:02.787039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665e7fcd-be8f-45f1-9a3d-4b395812298a None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:02.824474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade865ad-6851-4623-a910-6a299dc8df34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:02.825068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade865ad-6851-4623-a910-6a299dc8df34 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:02.825354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade865ad-6851-4623-a910-6a299dc8df34 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:02.825621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade865ad-6851-4623-a910-6a299dc8df34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:02.826361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade865ad-6851-4623-a910-6a299dc8df34 None admin] RBAC: Adding query filter params (interface=public, service_id=16589ebeb94a4994a9fdb7aba3af84af, region_id=RegionOne) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:07:02.826672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade865ad-6851-4623-a910-6a299dc8df34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:02.828056 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade865ad-6851-4623-a910-6a299dc8df34 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:02.833343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 657/1300] 10.222.0.39 () {56 vars in 1251 bytes} [Mon Aug 8 01:07:02 2022] GET /identity/v3/endpoints?service_id=16589ebeb94a4994a9fdb7aba3af84af&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:07:02.840328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:02.937176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:07:02.959406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5788d91f-42d8-48fd-ab3b-242521f76e22 None admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:02.996329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37044e3a-3b0d-40c5-a1b2-c87677f27b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:02.996928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044e3a-3b0d-40c5-a1b2-c87677f27b74 None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:02.997198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044e3a-3b0d-40c5-a1b2-c87677f27b74 None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:02.997466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37044e3a-3b0d-40c5-a1b2-c87677f27b74 None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:02.998097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044e3a-3b0d-40c5-a1b2-c87677f27b74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:02.999455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37044e3a-3b0d-40c5-a1b2-c87677f27b74 None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:03.006835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 644/1301] 10.222.0.39 () {56 vars in 1087 bytes} [Mon Aug 8 01:07:02 2022] GET /identity/v3/services => generated 2191 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:07:04.983279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba9fb-206b-4313-9cfb-76368071a7da None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:04.984211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba9fb-206b-4313-9cfb-76368071a7da None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:04.984211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1ba9fb-206b-4313-9cfb-76368071a7da None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:04.985680 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 658/1302] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:07:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:07:04.995331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c82df-664e-4694-9ceb-9fee2b87759d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:04.996039 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c82df-664e-4694-9ceb-9fee2b87759d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:04.996154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3c82df-664e-4694-9ceb-9fee2b87759d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:05.019140 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4c3c82df-664e-4694-9ceb-9fee2b87759d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:07:05.020471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4c3c82df-664e-4694-9ceb-9fee2b87759d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:07:05.101350 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 645/1303] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:07:04 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 08 01:07:05.125800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ba9fb-206b-4313-9cfb-76368071a7da None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:05.258820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:07:05.267319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1ba9fb-206b-4313-9cfb-76368071a7da None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:05.304373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:05.305002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:05.305277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:05.305543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:05.306145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:05.307572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 08 01:07:05.317299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 08 01:07:05.318544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.get_or_create( Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application with Lock( Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self._enter() Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application return self.creator() Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application created_value = creator( Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: ERROR keystone.server.flask.application Aug 08 01:07:05.319577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 659/1304] 10.222.0.39 () {56 vars in 1117 bytes} [Mon Aug 8 01:07:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 08 01:07:05.326292 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c82df-664e-4694-9ceb-9fee2b87759d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:05.421429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:07:05.451741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3c82df-664e-4694-9ceb-9fee2b87759d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:05.492181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e01ffa-82f1-42c1-a7a5-1e0a34d76c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:05.492788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01ffa-82f1-42c1-a7a5-1e0a34d76c0c None admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:05.493061 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01ffa-82f1-42c1-a7a5-1e0a34d76c0c None admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:05.493331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e01ffa-82f1-42c1-a7a5-1e0a34d76c0c None admin] PATH_INFO: `/v3/services` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:05.493956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01ffa-82f1-42c1-a7a5-1e0a34d76c0c None admin] RBAC: Adding query filter params (name=placement) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:07:05.494260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01ffa-82f1-42c1-a7a5-1e0a34d76c0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:05.495636 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e01ffa-82f1-42c1-a7a5-1e0a34d76c0c None admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:05.505431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 646/1305] 10.222.0.39 () {56 vars in 1116 bytes} [Mon Aug 8 01:07:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:07:05.511671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:07:05.639600 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaebf8ac-07bb-43db-aae0-dafcb1754028 None admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:07:05.682339 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c886fc89-657a-46ba-8472-b021f2e47c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:07:05.682942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886fc89-657a-46ba-8472-b021f2e47c5e None admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:07:05.683184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886fc89-657a-46ba-8472-b021f2e47c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:07:05.683478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c886fc89-657a-46ba-8472-b021f2e47c5e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:07:05.684143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886fc89-657a-46ba-8472-b021f2e47c5e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:07:05.685515 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c886fc89-657a-46ba-8472-b021f2e47c5e None admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:07:05.713649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 660/1306] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:07:05 2022] POST /identity/v3/endpoints => generated 331 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:07:15.497892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=30 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:07:15.707318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:09.131649 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cef1df-6721-4190-953d-425980a4ad39 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:09.132225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cef1df-6721-4190-953d-425980a4ad39 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:09.132225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cef1df-6721-4190-953d-425980a4ad39 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:09.138787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee44bc0-e152-40ed-8fcb-31d6fc0752ea None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:09.139244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee44bc0-e152-40ed-8fcb-31d6fc0752ea None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:09.139327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee44bc0-e152-40ed-8fcb-31d6fc0752ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:09.144159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 647/1307] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:09 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:09.241600 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6ee44bc0-e152-40ed-8fcb-31d6fc0752ea None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:09.244910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6ee44bc0-e152-40ed-8fcb-31d6fc0752ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:09.392669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 661/1308] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:08:09.442238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f632-4b9d-4d47-b91c-13c13b2b18a1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:09.442524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f632-4b9d-4d47-b91c-13c13b2b18a1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:09.442793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0f632-4b9d-4d47-b91c-13c13b2b18a1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:09.444428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 648/1309] 10.222.0.39 () {54 vars in 965 bytes} [Mon Aug 8 01:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:09.450385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66f43-c151-4989-8f02-6fcc17e180e2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:09.450814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66f43-c151-4989-8f02-6fcc17e180e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:09.451105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c66f43-c151-4989-8f02-6fcc17e180e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:09.541954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-51c66f43-c151-4989-8f02-6fcc17e180e2 None None] MFA Rules not processed for user `4af463e787364ed680b453d027c81f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:09.543182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-51c66f43-c151-4989-8f02-6fcc17e180e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:09.565932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:09.626994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 662/1310] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Aug 8 01:08:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:09.635744 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f632-4b9d-4d47-b91c-13c13b2b18a1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:09.637549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-86d0f632-4b9d-4d47-b91c-13c13b2b18a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:09.754900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0f632-4b9d-4d47-b91c-13c13b2b18a1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:09.837023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae09bf4e-9d66-4d5d-9810-2a0887324f2c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:09.838097 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09bf4e-9d66-4d5d-9810-2a0887324f2c service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:09.838584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09bf4e-9d66-4d5d-9810-2a0887324f2c service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:09.839055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae09bf4e-9d66-4d5d-9810-2a0887324f2c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:09.841970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ae09bf4e-9d66-4d5d-9810-2a0887324f2c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:09.909501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:09.974246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09bf4e-9d66-4d5d-9810-2a0887324f2c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:09.975752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae09bf4e-9d66-4d5d-9810-2a0887324f2c service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:09.996322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 649/1311] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:12.272417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d9185-0e72-4b4e-9a82-2f6bdef9f7de None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:12.273057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d9185-0e72-4b4e-9a82-2f6bdef9f7de None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:12.273057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d9185-0e72-4b4e-9a82-2f6bdef9f7de None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:12.274313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 663/1312] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:12.280166 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b05039-bf44-4579-9555-47393595fbfd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:12.280711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b05039-bf44-4579-9555-47393595fbfd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:12.280711 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b05039-bf44-4579-9555-47393595fbfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:12.378361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-66b05039-bf44-4579-9555-47393595fbfd None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:12.379541 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-66b05039-bf44-4579-9555-47393595fbfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:12.490169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 650/1313] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:12.542386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3277a77-8e54-42e6-83f5-72df2933ea20 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:12.542632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3277a77-8e54-42e6-83f5-72df2933ea20 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:12.542904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3277a77-8e54-42e6-83f5-72df2933ea20 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:12.544415 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 664/1314] 10.222.0.39 () {54 vars in 965 bytes} [Mon Aug 8 01:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:12.550790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63c7fc-f433-4b90-b046-80839f31398f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:12.551079 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63c7fc-f433-4b90-b046-80839f31398f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:12.551353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63c7fc-f433-4b90-b046-80839f31398f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:12.563456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:12.633129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8a63c7fc-f433-4b90-b046-80839f31398f None None] MFA Rules not processed for user `4af463e787364ed680b453d027c81f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:12.634330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8a63c7fc-f433-4b90-b046-80839f31398f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:12.716317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 651/1315] 10.222.0.39 () {58 vars in 1062 bytes} [Mon Aug 8 01:08:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:12.725858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3277a77-8e54-42e6-83f5-72df2933ea20 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:12.727425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b3277a77-8e54-42e6-83f5-72df2933ea20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:12.835690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3277a77-8e54-42e6-83f5-72df2933ea20 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:12.916189 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:12.919331 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b70275-e57f-4900-90ed-12250cf8e2f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:12.919962 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70275-e57f-4900-90ed-12250cf8e2f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:12.920247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70275-e57f-4900-90ed-12250cf8e2f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:12.920526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b70275-e57f-4900-90ed-12250cf8e2f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:12.923359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-02b70275-e57f-4900-90ed-12250cf8e2f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:13.041676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70275-e57f-4900-90ed-12250cf8e2f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:13.043165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b70275-e57f-4900-90ed-12250cf8e2f1 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:13.069477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 665/1316] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:15.591670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0120f8-68dc-4ebc-90c7-db254fe6cb6b None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:15.592261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0120f8-68dc-4ebc-90c7-db254fe6cb6b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:15.592261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0120f8-68dc-4ebc-90c7-db254fe6cb6b None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:15.593543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 652/1317] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:15.599876 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4f1f-8a7b-4027-b3ab-b68dc048323d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:15.600572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4f1f-8a7b-4027-b3ab-b68dc048323d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:15.600756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9d4f1f-8a7b-4027-b3ab-b68dc048323d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:15.671361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9e9d4f1f-8a7b-4027-b3ab-b68dc048323d None None] MFA Rules not processed for user `4d5bc0e65035421b90d55b3b2e8b5ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:15.672490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9e9d4f1f-8a7b-4027-b3ab-b68dc048323d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:15.725247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:15.778078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 666/1318] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:15.821041 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0120f8-68dc-4ebc-90c7-db254fe6cb6b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:15.822625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6f0120f8-68dc-4ebc-90c7-db254fe6cb6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:15.933067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0120f8-68dc-4ebc-90c7-db254fe6cb6b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:15.936116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:16.010693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc69a9e0-33e1-4fc7-ad4e-57a51bfbc50c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:16.011302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69a9e0-33e1-4fc7-ad4e-57a51bfbc50c service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:16.011575 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69a9e0-33e1-4fc7-ad4e-57a51bfbc50c service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:16.011864 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc69a9e0-33e1-4fc7-ad4e-57a51bfbc50c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:16.013445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dc69a9e0-33e1-4fc7-ad4e-57a51bfbc50c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:16.129779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69a9e0-33e1-4fc7-ad4e-57a51bfbc50c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:16.131252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc69a9e0-33e1-4fc7-ad4e-57a51bfbc50c service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:16.150586 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 653/1319] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:18.743567 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5120a25-73a1-4d82-9c74-54fb4310c002 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:18.744244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5120a25-73a1-4d82-9c74-54fb4310c002 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:18.744362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5120a25-73a1-4d82-9c74-54fb4310c002 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:18.746351 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 667/1320] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:18.755076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26448aa-41d9-45fc-afdc-7b9b327fbe98 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:18.755849 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26448aa-41d9-45fc-afdc-7b9b327fbe98 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:18.756011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26448aa-41d9-45fc-afdc-7b9b327fbe98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:18.803363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:18.828632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-f26448aa-41d9-45fc-afdc-7b9b327fbe98 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:18.829856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f26448aa-41d9-45fc-afdc-7b9b327fbe98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:18.937546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 654/1321] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:08:18.989579 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5120a25-73a1-4d82-9c74-54fb4310c002 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:18.992060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f5120a25-73a1-4d82-9c74-54fb4310c002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:19.106265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5120a25-73a1-4d82-9c74-54fb4310c002 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:19.182168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19c7adf-2dee-4487-9c4b-e77d2265ed44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:19.182767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7adf-2dee-4487-9c4b-e77d2265ed44 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:19.183042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7adf-2dee-4487-9c4b-e77d2265ed44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:19.183341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19c7adf-2dee-4487-9c4b-e77d2265ed44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:19.185010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f19c7adf-2dee-4487-9c4b-e77d2265ed44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:19.192555 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:19.299925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c7adf-2dee-4487-9c4b-e77d2265ed44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:19.301278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19c7adf-2dee-4487-9c4b-e77d2265ed44 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:19.319671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 668/1322] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:22.008213 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500cc0-d49a-42bf-af6d-d8563bc289f9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:22.008817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500cc0-d49a-42bf-af6d-d8563bc289f9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:22.008817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31500cc0-d49a-42bf-af6d-d8563bc289f9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:22.010338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 655/1323] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:22.015451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1889c-9be3-4412-ae06-c7666ea99463 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:22.015875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1889c-9be3-4412-ae06-c7666ea99463 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:22.015984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb1889c-9be3-4412-ae06-c7666ea99463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:22.085125 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8fb1889c-9be3-4412-ae06-c7666ea99463 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:22.086347 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8fb1889c-9be3-4412-ae06-c7666ea99463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:22.149840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:22.193102 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 669/1324] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:22.230618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31500cc0-d49a-42bf-af6d-d8563bc289f9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:22.232366 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-31500cc0-d49a-42bf-af6d-d8563bc289f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:22.350521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31500cc0-d49a-42bf-af6d-d8563bc289f9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:22.364115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:22.430131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b2891-b906-4a02-a57f-507c3ab08e99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:22.430857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2891-b906-4a02-a57f-507c3ab08e99 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:22.431136 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2891-b906-4a02-a57f-507c3ab08e99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:22.431408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b2891-b906-4a02-a57f-507c3ab08e99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:22.433028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7d0b2891-b906-4a02-a57f-507c3ab08e99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:22.543305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2891-b906-4a02-a57f-507c3ab08e99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:22.544746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b2891-b906-4a02-a57f-507c3ab08e99 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:22.563659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 656/1325] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:24.611119 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698be5-3703-4282-a3d0-ec2e761ba117 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:24.611684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698be5-3703-4282-a3d0-ec2e761ba117 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:24.611684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab698be5-3703-4282-a3d0-ec2e761ba117 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:24.613179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 670/1326] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:24.618420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7957-6e83-4af5-8e45-0fdad569a3e5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:24.618841 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7957-6e83-4af5-8e45-0fdad569a3e5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:24.619019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e7957-6e83-4af5-8e45-0fdad569a3e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:24.671322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:24.690476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e38e7957-6e83-4af5-8e45-0fdad569a3e5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:24.691692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e38e7957-6e83-4af5-8e45-0fdad569a3e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:24.791078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 657/1327] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:24.827544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698be5-3703-4282-a3d0-ec2e761ba117 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:24.829089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ab698be5-3703-4282-a3d0-ec2e761ba117 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:24.943276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab698be5-3703-4282-a3d0-ec2e761ba117 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:25.032739 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddaa0dc9-0c19-4087-a27e-b7787744a350 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:25.033371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa0dc9-0c19-4087-a27e-b7787744a350 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:25.033651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa0dc9-0c19-4087-a27e-b7787744a350 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:25.033918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaa0dc9-0c19-4087-a27e-b7787744a350 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:25.035682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ddaa0dc9-0c19-4087-a27e-b7787744a350 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:25.057357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:25.156141 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa0dc9-0c19-4087-a27e-b7787744a350 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:25.157581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddaa0dc9-0c19-4087-a27e-b7787744a350 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:25.176864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 671/1328] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:27.237423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a75f8c-5730-4064-94f8-a80cd5a84bd3 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:27.237985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a75f8c-5730-4064-94f8-a80cd5a84bd3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:27.237985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a75f8c-5730-4064-94f8-a80cd5a84bd3 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:27.239368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 658/1329] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:27.244703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fa86-22a1-4649-b23b-cf6db2f9e72d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:27.245181 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fa86-22a1-4649-b23b-cf6db2f9e72d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:27.245528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3593fa86-22a1-4649-b23b-cf6db2f9e72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:27.313495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3593fa86-22a1-4649-b23b-cf6db2f9e72d None None] MFA Rules not processed for user `4d5bc0e65035421b90d55b3b2e8b5ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:27.314724 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3593fa86-22a1-4649-b23b-cf6db2f9e72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:27.383894 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:27.418524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 672/1330] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:27 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:27.457728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a75f8c-5730-4064-94f8-a80cd5a84bd3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:27.459322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b4a75f8c-5730-4064-94f8-a80cd5a84bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:27.567510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a75f8c-5730-4064-94f8-a80cd5a84bd3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:27.589355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:27.643425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eefbcd-f5c9-4295-855f-e2cca9f65f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:27.643940 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eefbcd-f5c9-4295-855f-e2cca9f65f65 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:27.644214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eefbcd-f5c9-4295-855f-e2cca9f65f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:27.644482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eefbcd-f5c9-4295-855f-e2cca9f65f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:27.646082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-01eefbcd-f5c9-4295-855f-e2cca9f65f65 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:27.771670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eefbcd-f5c9-4295-855f-e2cca9f65f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:27.773124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eefbcd-f5c9-4295-855f-e2cca9f65f65 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:27.790995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 659/1331] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:27 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:30.084290 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f346bd-44df-4e88-b650-8ecbca38ffc1 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:30.085230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f346bd-44df-4e88-b650-8ecbca38ffc1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:30.085230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f346bd-44df-4e88-b650-8ecbca38ffc1 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:30.087408 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 673/1332] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:30.093245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf833113-d1a9-4bc8-bc90-56840a775cc8 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:30.093709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf833113-d1a9-4bc8-bc90-56840a775cc8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:30.093826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf833113-d1a9-4bc8-bc90-56840a775cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:30.166490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:30.169983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bf833113-d1a9-4bc8-bc90-56840a775cc8 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:30.171572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bf833113-d1a9-4bc8-bc90-56840a775cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:30.270086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 660/1333] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:30.306955 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f346bd-44df-4e88-b650-8ecbca38ffc1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:30.309957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-86f346bd-44df-4e88-b650-8ecbca38ffc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:30.421830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f346bd-44df-4e88-b650-8ecbca38ffc1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:30.496950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bd3351-25d6-4b46-9b9f-cf3085565747 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:30.497544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd3351-25d6-4b46-9b9f-cf3085565747 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:30.497820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd3351-25d6-4b46-9b9f-cf3085565747 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:30.498094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bd3351-25d6-4b46-9b9f-cf3085565747 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:30.499688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a5bd3351-25d6-4b46-9b9f-cf3085565747 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:30.532506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:30.621649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd3351-25d6-4b46-9b9f-cf3085565747 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:30.623137 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5bd3351-25d6-4b46-9b9f-cf3085565747 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:30.643060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 674/1334] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:32.719904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d3105-b623-419d-86f3-90937c874160 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:32.720610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d3105-b623-419d-86f3-90937c874160 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:32.720744 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7d3105-b623-419d-86f3-90937c874160 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:32.723043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 661/1335] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:32.728507 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cec2a-aa7e-4108-8eea-1a11fb1cc657 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:32.728949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cec2a-aa7e-4108-8eea-1a11fb1cc657 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:32.729043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410cec2a-aa7e-4108-8eea-1a11fb1cc657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:32.798742 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-410cec2a-aa7e-4108-8eea-1a11fb1cc657 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:32.799943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-410cec2a-aa7e-4108-8eea-1a11fb1cc657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:32.879465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:32.901998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 675/1336] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:32.943616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d3105-b623-419d-86f3-90937c874160 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:32.945904 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7e7d3105-b623-419d-86f3-90937c874160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:33.068439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7d3105-b623-419d-86f3-90937c874160 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:33.107285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:33.155945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dafed57-8bad-4e55-9993-add2a14d406d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:33.156548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafed57-8bad-4e55-9993-add2a14d406d service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:33.156825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafed57-8bad-4e55-9993-add2a14d406d service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:33.157091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dafed57-8bad-4e55-9993-add2a14d406d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:33.158718 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9dafed57-8bad-4e55-9993-add2a14d406d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:33.272849 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafed57-8bad-4e55-9993-add2a14d406d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:33.274328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dafed57-8bad-4e55-9993-add2a14d406d service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:33.292986 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 662/1337] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:35.638296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ac9d-479a-46e3-93d5-719045e84134 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:35.639179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ac9d-479a-46e3-93d5-719045e84134 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:35.639179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f2ac9d-479a-46e3-93d5-719045e84134 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:35.641341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 676/1338] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:35.647577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46f59-d2f7-4c63-bd98-b366c6f37838 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:35.648300 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46f59-d2f7-4c63-bd98-b366c6f37838 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:35.648448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e46f59-d2f7-4c63-bd98-b366c6f37838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:35.725874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-33e46f59-d2f7-4c63-bd98-b366c6f37838 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:35.727109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-33e46f59-d2f7-4c63-bd98-b366c6f37838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:35.736654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:35.828491 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 663/1339] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:35.878769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ac9d-479a-46e3-93d5-719045e84134 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:35.880310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-89f2ac9d-479a-46e3-93d5-719045e84134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:35.988317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f2ac9d-479a-46e3-93d5-719045e84134 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:36.062903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e45348-bf50-4e4e-9a5a-55a18e28d7fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:36.063499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45348-bf50-4e4e-9a5a-55a18e28d7fc service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:36.063767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45348-bf50-4e4e-9a5a-55a18e28d7fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:36.064032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e45348-bf50-4e4e-9a5a-55a18e28d7fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:36.065589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b0e45348-bf50-4e4e-9a5a-55a18e28d7fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:36.105852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:36.179937 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e45348-bf50-4e4e-9a5a-55a18e28d7fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:36.181374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e45348-bf50-4e4e-9a5a-55a18e28d7fc service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:36.201155 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 677/1340] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:40.177010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac79d-4eae-4ed1-a103-c4ed8abfaaa1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:40.177570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac79d-4eae-4ed1-a103-c4ed8abfaaa1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:40.177570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6ac79d-4eae-4ed1-a103-c4ed8abfaaa1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:40.178945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 664/1341] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:40.184549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0980062-c272-4676-8ad7-e5feee92d750 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:40.184975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0980062-c272-4676-8ad7-e5feee92d750 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:40.185083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0980062-c272-4676-8ad7-e5feee92d750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:40.257418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f0980062-c272-4676-8ad7-e5feee92d750 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:40.258688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f0980062-c272-4676-8ad7-e5feee92d750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:40.350116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:40.362645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 678/1342] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:40.402985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac79d-4eae-4ed1-a103-c4ed8abfaaa1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:40.404534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dc6ac79d-4eae-4ed1-a103-c4ed8abfaaa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:40.518947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6ac79d-4eae-4ed1-a103-c4ed8abfaaa1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:40.560158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:40.599265 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c1fee-aa1d-48b9-a4be-6f84907fd4c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:40.599909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1fee-aa1d-48b9-a4be-6f84907fd4c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:40.600402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1fee-aa1d-48b9-a4be-6f84907fd4c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:40.600402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c1fee-aa1d-48b9-a4be-6f84907fd4c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:40.602069 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-380c1fee-aa1d-48b9-a4be-6f84907fd4c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:40.723503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1fee-aa1d-48b9-a4be-6f84907fd4c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:40.725021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c1fee-aa1d-48b9-a4be-6f84907fd4c9 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:40.747994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 665/1343] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:43.845939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721f61-8b2e-410a-ad9d-b56437dc96f7 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:43.846506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721f61-8b2e-410a-ad9d-b56437dc96f7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:43.846506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45721f61-8b2e-410a-ad9d-b56437dc96f7 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:43.848050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 679/1344] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:43.853871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957dd2d-a3bf-47d4-9602-4480e0cd3148 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:43.854756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957dd2d-a3bf-47d4-9602-4480e0cd3148 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:43.855010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a957dd2d-a3bf-47d4-9602-4480e0cd3148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:43.924312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a957dd2d-a3bf-47d4-9602-4480e0cd3148 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:43.925546 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a957dd2d-a3bf-47d4-9602-4480e0cd3148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:43.944249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:44.023452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 666/1345] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:44.061250 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721f61-8b2e-410a-ad9d-b56437dc96f7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:44.062920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-45721f61-8b2e-410a-ad9d-b56437dc96f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:44.179885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45721f61-8b2e-410a-ad9d-b56437dc96f7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:44.257900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f51a980-597b-4d7b-b22e-33ad396ca531 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:44.258532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a980-597b-4d7b-b22e-33ad396ca531 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:44.258807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a980-597b-4d7b-b22e-33ad396ca531 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:44.259072 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f51a980-597b-4d7b-b22e-33ad396ca531 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:44.261357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8f51a980-597b-4d7b-b22e-33ad396ca531 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:44.306455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:44.376793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51a980-597b-4d7b-b22e-33ad396ca531 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:44.378307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f51a980-597b-4d7b-b22e-33ad396ca531 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:44.397407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 680/1346] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:44 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:48.657841 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ef58-089a-4c3e-8f98-c7ee6b2d9fa7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:48.658454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ef58-089a-4c3e-8f98-c7ee6b2d9fa7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:48.658454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d542ef58-089a-4c3e-8f98-c7ee6b2d9fa7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:48.659859 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 667/1347] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:48.665437 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b3857-29ed-4b6d-b1c2-56d02caf8348 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:48.666338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b3857-29ed-4b6d-b1c2-56d02caf8348 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:48.666338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8b3857-29ed-4b6d-b1c2-56d02caf8348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:48.741890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ea8b3857-29ed-4b6d-b1c2-56d02caf8348 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:48.743070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ea8b3857-29ed-4b6d-b1c2-56d02caf8348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:48.855245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:48.871046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 681/1348] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:08:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:08:48.896421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ef58-089a-4c3e-8f98-c7ee6b2d9fa7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:08:48.898134 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d542ef58-089a-4c3e-8f98-c7ee6b2d9fa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:49.023029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d542ef58-089a-4c3e-8f98-c7ee6b2d9fa7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:08:49.076111 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:49.102938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed45a39-458d-4e1c-9975-33fb3cbe2e6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:08:49.103785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed45a39-458d-4e1c-9975-33fb3cbe2e6b service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:49.104055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed45a39-458d-4e1c-9975-33fb3cbe2e6b service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:49.104317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed45a39-458d-4e1c-9975-33fb3cbe2e6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:49.105928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7ed45a39-458d-4e1c-9975-33fb3cbe2e6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:49.232623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed45a39-458d-4e1c-9975-33fb3cbe2e6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:08:49.234169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed45a39-458d-4e1c-9975-33fb3cbe2e6b service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:08:49.252093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 668/1349] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:08:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:08:54.219010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081919f6-70d7-40f1-b671-905e801a65e2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:54.220179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081919f6-70d7-40f1-b671-905e801a65e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:54.220661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081919f6-70d7-40f1-b671-905e801a65e2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:54.225232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 682/1350] 10.222.0.39 () {54 vars in 921 bytes} [Mon Aug 8 01:08:54 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:54.238015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8bcd-f367-4c8c-98fc-17126fd56df1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:54.251525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8bcd-f367-4c8c-98fc-17126fd56df1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:54.252076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fc8bcd-f367-4c8c-98fc-17126fd56df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:54.343072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-72fc8bcd-f367-4c8c-98fc-17126fd56df1 None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:54.344269 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-72fc8bcd-f367-4c8c-98fc-17126fd56df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:54.363895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:54.462823 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 669/1351] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Aug 8 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:08:58.499135 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce621b33-0873-4c52-95d1-6d593ea88293 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:58.499819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce621b33-0873-4c52-95d1-6d593ea88293 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:58.499819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce621b33-0873-4c52-95d1-6d593ea88293 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:58.501236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 683/1352] 10.222.0.39 () {54 vars in 921 bytes} [Mon Aug 8 01:08:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:08:58.506331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e023d-56cc-4276-aedc-42fe11c505d8 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:08:58.507252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e023d-56cc-4276-aedc-42fe11c505d8 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:08:58.507526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7e023d-56cc-4276-aedc-42fe11c505d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:08:58.587841 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2a7e023d-56cc-4276-aedc-42fe11c505d8 None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:08:58.589053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2a7e023d-56cc-4276-aedc-42fe11c505d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:08:58.664358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:08:58.705293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 670/1353] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Aug 8 01:08:58 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:00.118106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17070bb8-5618-4c17-a6ae-05e341dc85ef None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:00.118736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17070bb8-5618-4c17-a6ae-05e341dc85ef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:00.118736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17070bb8-5618-4c17-a6ae-05e341dc85ef None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:00.120223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 684/1354] 10.222.0.39 () {54 vars in 921 bytes} [Mon Aug 8 01:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:00.125353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c3147-672c-48ce-aad2-ed8e24919890 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:00.125789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c3147-672c-48ce-aad2-ed8e24919890 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:00.126028 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5c3147-672c-48ce-aad2-ed8e24919890 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:00.207762 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ab5c3147-672c-48ce-aad2-ed8e24919890 None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:00.208964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ab5c3147-672c-48ce-aad2-ed8e24919890 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:00.326014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 671/1355] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Aug 8 01:09:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:03.647314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c0d3-cc6c-4cdb-9f5e-98649c507419 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:03.647884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c0d3-cc6c-4cdb-9f5e-98649c507419 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:03.647884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c0d3-cc6c-4cdb-9f5e-98649c507419 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:03.649196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 685/1356] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:03.655011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa78ffb-43ae-45a2-b1da-9a2a8fc039dd None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:03.655516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa78ffb-43ae-45a2-b1da-9a2a8fc039dd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:03.655601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa78ffb-43ae-45a2-b1da-9a2a8fc039dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:03.699535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:03.738454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-6aa78ffb-43ae-45a2-b1da-9a2a8fc039dd None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:03.739685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6aa78ffb-43ae-45a2-b1da-9a2a8fc039dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:03.840780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 672/1357] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:03.896380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e161-d9b2-4005-8ba2-0bfe6547ec5f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:03.897064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e161-d9b2-4005-8ba2-0bfe6547ec5f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:03.897566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c75e161-d9b2-4005-8ba2-0bfe6547ec5f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:03.900662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 686/1358] 10.222.0.39 () {54 vars in 962 bytes} [Mon Aug 8 01:09:03 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:03.911686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b804a05-4b1c-4ff3-8d6d-a05d950ed925 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:03.912359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b804a05-4b1c-4ff3-8d6d-a05d950ed925 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:03.913148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b804a05-4b1c-4ff3-8d6d-a05d950ed925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:04.003199 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1b804a05-4b1c-4ff3-8d6d-a05d950ed925 None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:04.004802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1b804a05-4b1c-4ff3-8d6d-a05d950ed925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:04.060280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:04.142403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 673/1359] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Aug 8 01:09:03 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:04.150974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75e161-d9b2-4005-8ba2-0bfe6547ec5f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:04.152498 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4c75e161-d9b2-4005-8ba2-0bfe6547ec5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:04.319558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c75e161-d9b2-4005-8ba2-0bfe6547ec5f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:04.397048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:04.441552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab6366-85ab-4959-b606-8128e1f5891a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:04.442284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6366-85ab-4959-b606-8128e1f5891a service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:04.442560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6366-85ab-4959-b606-8128e1f5891a service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:04.442836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab6366-85ab-4959-b606-8128e1f5891a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:04.444676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-73ab6366-85ab-4959-b606-8128e1f5891a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:04.544043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab6366-85ab-4959-b606-8128e1f5891a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:04.545770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab6366-85ab-4959-b606-8128e1f5891a service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:04.566368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 687/1360] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:06.839763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa904d2-231e-40e9-be47-85a51341cf52 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:06.840357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa904d2-231e-40e9-be47-85a51341cf52 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:06.840357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa904d2-231e-40e9-be47-85a51341cf52 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:06.841834 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 674/1361] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:06.847774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f9011-e207-45cc-ae46-312418b6610d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:06.847774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f9011-e207-45cc-ae46-312418b6610d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:06.848291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588f9011-e207-45cc-ae46-312418b6610d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:06.917092 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-588f9011-e207-45cc-ae46-312418b6610d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:06.918328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-588f9011-e207-45cc-ae46-312418b6610d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:06.957756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:07.025770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 688/1362] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:07.072764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa904d2-231e-40e9-be47-85a51341cf52 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:07.074349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9fa904d2-231e-40e9-be47-85a51341cf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:07.251949 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa904d2-231e-40e9-be47-85a51341cf52 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:07.271623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:07.415540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d919db5d-ed2a-45a9-911d-ec5173ee1aa4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:07.416775 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919db5d-ed2a-45a9-911d-ec5173ee1aa4 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:07.417202 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919db5d-ed2a-45a9-911d-ec5173ee1aa4 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:07.417709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d919db5d-ed2a-45a9-911d-ec5173ee1aa4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:07.419625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d919db5d-ed2a-45a9-911d-ec5173ee1aa4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:07.517050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919db5d-ed2a-45a9-911d-ec5173ee1aa4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:07.518971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d919db5d-ed2a-45a9-911d-ec5173ee1aa4 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:07.540589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 675/1363] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 468 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:09.876483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87ffc-4541-4034-9120-d26a9c8f7357 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:09.878114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87ffc-4541-4034-9120-d26a9c8f7357 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:09.878114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed87ffc-4541-4034-9120-d26a9c8f7357 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:09.880015 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 689/1364] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:09.886165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6e42-e0d2-4b78-bf69-a0dc9781e717 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:09.886165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6e42-e0d2-4b78-bf69-a0dc9781e717 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:09.886165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae6e42-e0d2-4b78-bf69-a0dc9781e717 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:09.902363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:09.964233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1aae6e42-e0d2-4b78-bf69-a0dc9781e717 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:09.965782 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1aae6e42-e0d2-4b78-bf69-a0dc9781e717 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:10.070331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 676/1365] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:10.117438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9914-0aa9-44ca-aa73-d9442ec3583c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:10.117763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9914-0aa9-44ca-aa73-d9442ec3583c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:10.117953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ab9914-0aa9-44ca-aa73-d9442ec3583c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:10.121756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 690/1366] 10.222.0.39 () {54 vars in 962 bytes} [Mon Aug 8 01:09:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:10.128483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46874f-19f2-4413-a204-d19f3435383a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:10.128743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46874f-19f2-4413-a204-d19f3435383a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:10.129082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46874f-19f2-4413-a204-d19f3435383a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:10.212770 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0d46874f-19f2-4413-a204-d19f3435383a None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:10.214089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0d46874f-19f2-4413-a204-d19f3435383a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:10.251808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:10.342680 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 677/1367] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Aug 8 01:09:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:10.352026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9914-0aa9-44ca-aa73-d9442ec3583c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:10.353744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e7ab9914-0aa9-44ca-aa73-d9442ec3583c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:10.509685 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ab9914-0aa9-44ca-aa73-d9442ec3583c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:10.532070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:10.629780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfc91c-3a24-4f9f-aa4d-30a3009e4051 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:10.630580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc91c-3a24-4f9f-aa4d-30a3009e4051 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:10.630961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc91c-3a24-4f9f-aa4d-30a3009e4051 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:10.631336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfc91c-3a24-4f9f-aa4d-30a3009e4051 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:10.633118 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-84cfc91c-3a24-4f9f-aa4d-30a3009e4051 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:10.727762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfc91c-3a24-4f9f-aa4d-30a3009e4051 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:10.729531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfc91c-3a24-4f9f-aa4d-30a3009e4051 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:10.750735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 691/1368] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:09:11.702074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b70c8-43ae-4486-8d88-d8ba0b3cc4f7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:11.702653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b70c8-43ae-4486-8d88-d8ba0b3cc4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:11.703116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d7b70c8-43ae-4486-8d88-d8ba0b3cc4f7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:11.704637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 678/1369] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:11.710145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75d44-bff6-4b65-b9f9-e71301fb7ccc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:11.710627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75d44-bff6-4b65-b9f9-e71301fb7ccc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:11.710983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75d44-bff6-4b65-b9f9-e71301fb7ccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:11.744975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:11.784866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-26b75d44-bff6-4b65-b9f9-e71301fb7ccc None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:11.786266 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-26b75d44-bff6-4b65-b9f9-e71301fb7ccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:11.890101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 692/1370] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:12.249475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97864a-61d6-44e6-8e6e-81f57aae64d6 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:12.249808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97864a-61d6-44e6-8e6e-81f57aae64d6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:12.250021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a97864a-61d6-44e6-8e6e-81f57aae64d6 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:12.251658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 679/1371] 10.222.0.39 () {54 vars in 964 bytes} [Mon Aug 8 01:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:12.257112 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ad6f-d664-4391-bf9b-062b173d1957 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:12.257620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ad6f-d664-4391-bf9b-062b173d1957 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:12.257872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d9ad6f-d664-4391-bf9b-062b173d1957 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:12.336964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-51d9ad6f-d664-4391-bf9b-062b173d1957 None None] MFA Rules not processed for user `a043a385f94e4aef84280c4a1533da28`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:12.338212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-51d9ad6f-d664-4391-bf9b-062b173d1957 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:12.386274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:12.418854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 693/1372] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Aug 8 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:12.426431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97864a-61d6-44e6-8e6e-81f57aae64d6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:12.427964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0a97864a-61d6-44e6-8e6e-81f57aae64d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:12.535923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a97864a-61d6-44e6-8e6e-81f57aae64d6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:12.582274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:12.618603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91f26d7-8f26-406c-8db4-279b9a1d84dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:12.619383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f26d7-8f26-406c-8db4-279b9a1d84dc service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:12.619774 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f26d7-8f26-406c-8db4-279b9a1d84dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:12.620147 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91f26d7-8f26-406c-8db4-279b9a1d84dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:12.621839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a91f26d7-8f26-406c-8db4-279b9a1d84dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:12.735233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f26d7-8f26-406c-8db4-279b9a1d84dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:12.736926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91f26d7-8f26-406c-8db4-279b9a1d84dc service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:12.756334 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 680/1373] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:12.833554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700295-be55-4b42-851e-a237e068a3b5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:12.834152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700295-be55-4b42-851e-a237e068a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:12.834152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57700295-be55-4b42-851e-a237e068a3b5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:12.835682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 694/1374] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:12.841710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc20f-a738-4a61-b88a-295e3a1bcf43 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:12.841999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc20f-a738-4a61-b88a-295e3a1bcf43 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:12.842327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2dc20f-a738-4a61-b88a-295e3a1bcf43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:12.910071 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8e2dc20f-a738-4a61-b88a-295e3a1bcf43 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:12.911296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8e2dc20f-a738-4a61-b88a-295e3a1bcf43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:12.932780 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:13.014676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 681/1375] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:13.060776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700295-be55-4b42-851e-a237e068a3b5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:13.064470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-57700295-be55-4b42-851e-a237e068a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:13.246013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57700295-be55-4b42-851e-a237e068a3b5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:13.298744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:13.361147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0183f312-6f72-4dfa-938e-8245d0f3aa77 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:13.361758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f312-6f72-4dfa-938e-8245d0f3aa77 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:13.362027 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f312-6f72-4dfa-938e-8245d0f3aa77 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:13.362322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0183f312-6f72-4dfa-938e-8245d0f3aa77 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:13.363902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0183f312-6f72-4dfa-938e-8245d0f3aa77 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:13.458249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183f312-6f72-4dfa-938e-8245d0f3aa77 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:13.459890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0183f312-6f72-4dfa-938e-8245d0f3aa77 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:13.479048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 695/1376] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:15.510739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24af5d-2485-40a9-8052-1d55ed1e275e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:15.511299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24af5d-2485-40a9-8052-1d55ed1e275e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:15.511299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c24af5d-2485-40a9-8052-1d55ed1e275e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:15.512662 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 682/1377] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:15.518201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d119636-b0c3-4cab-bfb7-ca890b10be32 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:15.518676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d119636-b0c3-4cab-bfb7-ca890b10be32 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:15.518780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d119636-b0c3-4cab-bfb7-ca890b10be32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:15.586117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4d119636-b0c3-4cab-bfb7-ca890b10be32 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:15.587336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4d119636-b0c3-4cab-bfb7-ca890b10be32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:15.594123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:15.688853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 696/1378] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:09:15.745356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24af5d-2485-40a9-8052-1d55ed1e275e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:15.747021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7c24af5d-2485-40a9-8052-1d55ed1e275e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:15.896553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c24af5d-2485-40a9-8052-1d55ed1e275e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:15.901045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:16.013602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d4580-ab41-4f11-a6e3-5c4091d26f0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:16.014252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4580-ab41-4f11-a6e3-5c4091d26f0a service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:16.014531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4580-ab41-4f11-a6e3-5c4091d26f0a service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:16.014797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d4580-ab41-4f11-a6e3-5c4091d26f0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:16.016404 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-133d4580-ab41-4f11-a6e3-5c4091d26f0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:16.120719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d4580-ab41-4f11-a6e3-5c4091d26f0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:16.122473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d4580-ab41-4f11-a6e3-5c4091d26f0a service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:16.146985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 683/1379] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:18.232418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d276bf-7d7a-4b0d-9452-e7f1670df9ed None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:18.233016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d276bf-7d7a-4b0d-9452-e7f1670df9ed None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:18.233016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d276bf-7d7a-4b0d-9452-e7f1670df9ed None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:18.234490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 697/1380] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:18.239616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879cf7-5d57-4c5a-8e54-0ebdee19f29f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:18.240048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879cf7-5d57-4c5a-8e54-0ebdee19f29f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:18.240165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d879cf7-5d57-4c5a-8e54-0ebdee19f29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:18.251766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:18.311548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3d879cf7-5d57-4c5a-8e54-0ebdee19f29f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:18.312732 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3d879cf7-5d57-4c5a-8e54-0ebdee19f29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:18.414356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 684/1381] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:09:18.458372 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d276bf-7d7a-4b0d-9452-e7f1670df9ed None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:18.460048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f4d276bf-7d7a-4b0d-9452-e7f1670df9ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:18.607333 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:18.619533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d276bf-7d7a-4b0d-9452-e7f1670df9ed None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:18.736167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40573d39-a99b-44d9-8a7c-311b225fd18a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:18.736487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573d39-a99b-44d9-8a7c-311b225fd18a service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:18.736689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573d39-a99b-44d9-8a7c-311b225fd18a service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:18.736907 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40573d39-a99b-44d9-8a7c-311b225fd18a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:18.738516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-40573d39-a99b-44d9-8a7c-311b225fd18a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:18.833348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40573d39-a99b-44d9-8a7c-311b225fd18a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:18.835041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40573d39-a99b-44d9-8a7c-311b225fd18a service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:18.845958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:18.858233 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 698/1382] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:20.965830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb27f2-47ee-4e61-b465-c7c69daf22fa None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:20.966697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb27f2-47ee-4e61-b465-c7c69daf22fa None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:20.966697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbb27f2-47ee-4e61-b465-c7c69daf22fa None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:20.967810 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 685/1383] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:09:20.973493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1adca7-4fa5-4b0d-ad03-055a11c7b387 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:20.973988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1adca7-4fa5-4b0d-ad03-055a11c7b387 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:20.974292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1adca7-4fa5-4b0d-ad03-055a11c7b387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:21.061202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-1a1adca7-4fa5-4b0d-ad03-055a11c7b387 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:21.062860 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-1a1adca7-4fa5-4b0d-ad03-055a11c7b387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:21.187475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 699/1384] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:21.231431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb27f2-47ee-4e61-b465-c7c69daf22fa None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:21.232989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3fbb27f2-47ee-4e61-b465-c7c69daf22fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:21.327693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:21.404066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbb27f2-47ee-4e61-b465-c7c69daf22fa None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:21.524561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78421ec3-58d3-4469-be04-dfd4410163c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:21.525179 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78421ec3-58d3-4469-be04-dfd4410163c7 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:21.525456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78421ec3-58d3-4469-be04-dfd4410163c7 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:21.525727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78421ec3-58d3-4469-be04-dfd4410163c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:21.527381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-78421ec3-58d3-4469-be04-dfd4410163c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:21.580211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:21.624578 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78421ec3-58d3-4469-be04-dfd4410163c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:21.627056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78421ec3-58d3-4469-be04-dfd4410163c7 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:21.650844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 686/1385] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:23.673578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923084-53fc-4f7e-b710-3c4dcec9ba74 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:23.674299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923084-53fc-4f7e-b710-3c4dcec9ba74 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:23.674299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94923084-53fc-4f7e-b710-3c4dcec9ba74 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:23.675764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 700/1386] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:23.681396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3a940-63ab-4b87-b3e3-cfab1a87fc06 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:23.681914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3a940-63ab-4b87-b3e3-cfab1a87fc06 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:23.681914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf3a940-63ab-4b87-b3e3-cfab1a87fc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:23.751398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-abf3a940-63ab-4b87-b3e3-cfab1a87fc06 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:23.752581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-abf3a940-63ab-4b87-b3e3-cfab1a87fc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:23.864969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 687/1387] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:23.913096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923084-53fc-4f7e-b710-3c4dcec9ba74 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:23.914994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-94923084-53fc-4f7e-b710-3c4dcec9ba74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:23.995847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:24.071004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94923084-53fc-4f7e-b710-3c4dcec9ba74 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:24.230190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11a8e4a-1e15-4137-b7d8-f960f333d489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:24.231064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a8e4a-1e15-4137-b7d8-f960f333d489 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:24.231416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a8e4a-1e15-4137-b7d8-f960f333d489 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:24.231763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11a8e4a-1e15-4137-b7d8-f960f333d489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:24.233905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f11a8e4a-1e15-4137-b7d8-f960f333d489 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:24.292290 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:24.349223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a8e4a-1e15-4137-b7d8-f960f333d489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:24.351526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11a8e4a-1e15-4137-b7d8-f960f333d489 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:24.371428 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 701/1388] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:26.444029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973adf-2989-4428-9071-0d5708c925e2 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:26.444551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973adf-2989-4428-9071-0d5708c925e2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:26.444551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1973adf-2989-4428-9071-0d5708c925e2 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:26.445869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 688/1389] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:26.451386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784100d3-98fa-4816-8195-d14e09fd0980 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:26.451785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784100d3-98fa-4816-8195-d14e09fd0980 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:26.451952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784100d3-98fa-4816-8195-d14e09fd0980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:26.522501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-784100d3-98fa-4816-8195-d14e09fd0980 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:26.523734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-784100d3-98fa-4816-8195-d14e09fd0980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:26.624559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 702/1390] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:26.669580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973adf-2989-4428-9071-0d5708c925e2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:26.671148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a1973adf-2989-4428-9071-0d5708c925e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:26.703846 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:26.829203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1973adf-2989-4428-9071-0d5708c925e2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:26.932214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:26.944799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cebefc2-2bb9-4b7f-885b-f19aabec047e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:26.945416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebefc2-2bb9-4b7f-885b-f19aabec047e service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:26.945681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebefc2-2bb9-4b7f-885b-f19aabec047e service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:26.945950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cebefc2-2bb9-4b7f-885b-f19aabec047e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:26.947586 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2cebefc2-2bb9-4b7f-885b-f19aabec047e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:27.036898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebefc2-2bb9-4b7f-885b-f19aabec047e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:27.038538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cebefc2-2bb9-4b7f-885b-f19aabec047e service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:27.057283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 689/1391] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 388 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:27.705758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2bc4-be5b-4bc5-902d-6478cb0efe8b None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:27.706374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2bc4-be5b-4bc5-902d-6478cb0efe8b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:27.706374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bd2bc4-be5b-4bc5-902d-6478cb0efe8b None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:27.707714 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 703/1392] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:27.713236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878ea78-2021-4780-8b24-8fa5f975efab None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:27.713668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878ea78-2021-4780-8b24-8fa5f975efab None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:27.713776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a878ea78-2021-4780-8b24-8fa5f975efab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:27.782375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a878ea78-2021-4780-8b24-8fa5f975efab None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:27.783574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a878ea78-2021-4780-8b24-8fa5f975efab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:27.847500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:27.889348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 690/1393] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:27.946262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e8b6-b5d5-4e09-97af-b4c38658db87 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:27.946545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e8b6-b5d5-4e09-97af-b4c38658db87 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:27.946814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f323e8b6-b5d5-4e09-97af-b4c38658db87 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:27.948142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 704/1394] 10.222.0.39 () {54 vars in 966 bytes} [Mon Aug 8 01:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:27.953301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f0da-093c-4e60-8987-feaaf323d8ee None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:27.953595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f0da-093c-4e60-8987-feaaf323d8ee None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:27.953831 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362f0da-093c-4e60-8987-feaaf323d8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:28.033375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5362f0da-093c-4e60-8987-feaaf323d8ee None None] MFA Rules not processed for user `74ee9575f99d40b88236d82f14780260`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:28.034648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5362f0da-093c-4e60-8987-feaaf323d8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:28.118261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 691/1395] 10.222.0.39 () {58 vars in 1063 bytes} [Mon Aug 8 01:09:27 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:28.126744 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e8b6-b5d5-4e09-97af-b4c38658db87 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:28.128362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f323e8b6-b5d5-4e09-97af-b4c38658db87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:28.143677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:28.238090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f323e8b6-b5d5-4e09-97af-b4c38658db87 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:28.315249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dd196a-8079-4264-b167-0e4d2c9981c6 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee9575f99d40b88236d82f14780260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:28.315765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd196a-8079-4264-b167-0e4d2c9981c6 service glance] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:28.316045 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd196a-8079-4264-b167-0e4d2c9981c6 service glance] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:28.316316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dd196a-8079-4264-b167-0e4d2c9981c6 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:28.317984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-66dd196a-8079-4264-b167-0e4d2c9981c6 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:28.386603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:28.428719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd196a-8079-4264-b167-0e4d2c9981c6 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:28.430212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dd196a-8079-4264-b167-0e4d2c9981c6 service glance] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:28.448109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 705/1396] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:29.069053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4592a2-4917-4133-aac6-9b4385728cf4 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:29.069640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4592a2-4917-4133-aac6-9b4385728cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:29.069640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4592a2-4917-4133-aac6-9b4385728cf4 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:29.071010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 692/1397] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:29.077034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:29.077612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:29.077612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:29.152920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:29.154169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:29.197015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797589-599b-4811-a0a5-fbbcf375c50e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:29.197476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797589-599b-4811-a0a5-fbbcf375c50e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:29.197703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6797589-599b-4811-a0a5-fbbcf375c50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:29.267358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a6797589-599b-4811-a0a5-fbbcf375c50e None None] MFA Rules not processed for user `091efb05bd0b47fd87d3641bf7354284`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:29.268619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a6797589-599b-4811-a0a5-fbbcf375c50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:29.272844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 706/1398] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:29.277315 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:29.316930 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:29.318288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:29.346244 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:29.357569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 693/1399] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Aug 8 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:29.403679 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f2f2-3f26-42ac-9f4d-6c1aeb89a0f1 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:29.403964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f2f2-3f26-42ac-9f4d-6c1aeb89a0f1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:29.404232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5f2f2-3f26-42ac-9f4d-6c1aeb89a0f1 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:29.405788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 694/1400] 10.222.0.39 () {54 vars in 943 bytes} [Mon Aug 8 01:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:29.412131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da5c45-b94d-41e4-9bd1-2179e23f9cb2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:29.412414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da5c45-b94d-41e4-9bd1-2179e23f9cb2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:29.412688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32da5c45-b94d-41e4-9bd1-2179e23f9cb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:29.436886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486a8eef-d45a-467b-ba66-b4020f2bc9a1 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:29.494875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-32da5c45-b94d-41e4-9bd1-2179e23f9cb2 None None] MFA Rules not processed for user `d6ee2855740e4797afb4843d04446870`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:29.496086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-32da5c45-b94d-41e4-9bd1-2179e23f9cb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:29.553505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8dc553-4b3a-4535-9a16-28d1c2afd0a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:29.554141 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc553-4b3a-4535-9a16-28d1c2afd0a5 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:29.554409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc553-4b3a-4535-9a16-28d1c2afd0a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:29.554674 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8dc553-4b3a-4535-9a16-28d1c2afd0a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:29.556285 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9e8dc553-4b3a-4535-9a16-28d1c2afd0a5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:29.575630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:29.581226 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:29.604473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 695/1401] 10.222.0.39 () {58 vars in 1040 bytes} [Mon Aug 8 01:09:29 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:09:29.613955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da5c45-b94d-41e4-9bd1-2179e23f9cb2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:29.624473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32da5c45-b94d-41e4-9bd1-2179e23f9cb2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:29.651208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dc553-4b3a-4535-9a16-28d1c2afd0a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:29.652831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8dc553-4b3a-4535-9a16-28d1c2afd0a5 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:29.671968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 707/1402] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:09:29.735739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286da26a-400d-401a-afbe-338341625be4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ee2855740e4797afb4843d04446870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:29.736358 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da26a-400d-401a-afbe-338341625be4 service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:29.736633 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da26a-400d-401a-afbe-338341625be4 service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:29.736894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286da26a-400d-401a-afbe-338341625be4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:29.738558 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-286da26a-400d-401a-afbe-338341625be4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:29.835203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da26a-400d-401a-afbe-338341625be4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:29.836856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286da26a-400d-401a-afbe-338341625be4 service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:29.846312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 696/1403] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Aug 8 01:09:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 01:09:31.744007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440770a9-618a-4935-a5a4-cd52b6c7b1ea None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:31.744486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440770a9-618a-4935-a5a4-cd52b6c7b1ea None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:31.744486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440770a9-618a-4935-a5a4-cd52b6c7b1ea None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:31.745908 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 708/1404] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:31.751186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dab9a-18d5-4496-a6ff-d6c5ef8fbac4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:31.751616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dab9a-18d5-4496-a6ff-d6c5ef8fbac4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:31.751714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1dab9a-18d5-4496-a6ff-d6c5ef8fbac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:31.767298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:31.833151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1d1dab9a-18d5-4496-a6ff-d6c5ef8fbac4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:31.834445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1d1dab9a-18d5-4496-a6ff-d6c5ef8fbac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:31.987162 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 697/1405] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:32.032271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440770a9-618a-4935-a5a4-cd52b6c7b1ea None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:32.033847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-440770a9-618a-4935-a5a4-cd52b6c7b1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:32.200335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:32.202715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440770a9-618a-4935-a5a4-cd52b6c7b1ea None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:32.322790 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed8005-f6fd-4117-b45c-c3b61d015e6a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:32.323563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8005-f6fd-4117-b45c-c3b61d015e6a service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:32.323904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8005-f6fd-4117-b45c-c3b61d015e6a service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:32.324180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed8005-f6fd-4117-b45c-c3b61d015e6a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:32.325841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5aed8005-f6fd-4117-b45c-c3b61d015e6a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:32.420770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed8005-f6fd-4117-b45c-c3b61d015e6a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:32.422412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed8005-f6fd-4117-b45c-c3b61d015e6a service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:32.441559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 709/1406] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:34.486712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f80e-79f2-4840-8cf2-0ef928908ecd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:34.487328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f80e-79f2-4840-8cf2-0ef928908ecd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:34.487328 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0991f80e-79f2-4840-8cf2-0ef928908ecd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:34.492985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 698/1407] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:09:34 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:34.494812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e258-8055-4589-993f-b2c5b5b5e588 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:34.495750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e258-8055-4589-993f-b2c5b5b5e588 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:34.496028 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec67e258-8055-4589-993f-b2c5b5b5e588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:34.500666 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:34.568034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ec67e258-8055-4589-993f-b2c5b5b5e588 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:34.569280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ec67e258-8055-4589-993f-b2c5b5b5e588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:34.681384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 710/1408] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:09:34.727086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991f80e-79f2-4840-8cf2-0ef928908ecd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:34.729001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0991f80e-79f2-4840-8cf2-0ef928908ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:34.825410 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:34.900303 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0991f80e-79f2-4840-8cf2-0ef928908ecd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:35.035280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d93f4b-81fa-4f47-b399-c8834bc4f7a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:35.035900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93f4b-81fa-4f47-b399-c8834bc4f7a4 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:35.036314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93f4b-81fa-4f47-b399-c8834bc4f7a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:35.036592 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d93f4b-81fa-4f47-b399-c8834bc4f7a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:35.038285 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e1d93f4b-81fa-4f47-b399-c8834bc4f7a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:35.101555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:35.167251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d93f4b-81fa-4f47-b399-c8834bc4f7a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:35.169987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d93f4b-81fa-4f47-b399-c8834bc4f7a4 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:35.202088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 699/1409] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:44.679079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=64 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:45.196754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=23 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:51.858652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0dbd6-58e6-4917-9075-ce56d3ce5618 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:51.859257 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0dbd6-58e6-4917-9075-ce56d3ce5618 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:51.859257 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f0dbd6-58e6-4917-9075-ce56d3ce5618 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:51.860561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 711/1410] 10.222.0.39 () {54 vars in 918 bytes} [Mon Aug 8 01:09:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:51.865928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c0c2-f806-4ac4-b766-ea9eea65e13e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:51.866892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c0c2-f806-4ac4-b766-ea9eea65e13e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:51.866892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b9c0c2-f806-4ac4-b766-ea9eea65e13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:51.946563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-32b9c0c2-f806-4ac4-b766-ea9eea65e13e None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:51.947789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-32b9c0c2-f806-4ac4-b766-ea9eea65e13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:52.076248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 700/1411] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Aug 8 01:09:51 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:52.091945 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e91ed-7cc1-4354-8b4f-928db27c237d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:52.092226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e91ed-7cc1-4354-8b4f-928db27c237d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:52.092503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956e91ed-7cc1-4354-8b4f-928db27c237d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:52.093880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 712/1412] 10.222.0.39 () {54 vars in 918 bytes} [Mon Aug 8 01:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:52.099453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee81e1e-6434-480c-b5a4-670692d4ca3b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:52.099946 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee81e1e-6434-480c-b5a4-670692d4ca3b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:52.100245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee81e1e-6434-480c-b5a4-670692d4ca3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:52.175365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:52.179000 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0ee81e1e-6434-480c-b5a4-670692d4ca3b None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:52.180264 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0ee81e1e-6434-480c-b5a4-670692d4ca3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:52.307694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 701/1413] 10.222.0.39 () {58 vars in 1015 bytes} [Mon Aug 8 01:09:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:54.757139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2d823-f550-4e44-904c-cb73424921a9 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:54.757778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2d823-f550-4e44-904c-cb73424921a9 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:54.757778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2d823-f550-4e44-904c-cb73424921a9 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:54.759195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 713/1414] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:54.765527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c5f28-4920-4f99-8b2c-4052db26b9f0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:54.765970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c5f28-4920-4f99-8b2c-4052db26b9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:54.766103 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110c5f28-4920-4f99-8b2c-4052db26b9f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:54.837738 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-110c5f28-4920-4f99-8b2c-4052db26b9f0 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:54.839170 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-110c5f28-4920-4f99-8b2c-4052db26b9f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:54.902011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:54.945624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 702/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:09:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:54.990017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2d823-f550-4e44-904c-cb73424921a9 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:54.992102 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-84c2d823-f550-4e44-904c-cb73424921a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:55.147831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2d823-f550-4e44-904c-cb73424921a9 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:55.230373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:55.274816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7557daa1-56dc-4abf-bd45-495b3a8b7a96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:55.275421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557daa1-56dc-4abf-bd45-495b3a8b7a96 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:55.275694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557daa1-56dc-4abf-bd45-495b3a8b7a96 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:55.275965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7557daa1-56dc-4abf-bd45-495b3a8b7a96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:55.277559 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7557daa1-56dc-4abf-bd45-495b3a8b7a96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:55.374484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557daa1-56dc-4abf-bd45-495b3a8b7a96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:55.376008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7557daa1-56dc-4abf-bd45-495b3a8b7a96 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:55.394463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 714/1416] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:56.298003 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad29d-8c45-4cda-b7a1-6667c59535d0 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:56.298942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad29d-8c45-4cda-b7a1-6667c59535d0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:56.298942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800ad29d-8c45-4cda-b7a1-6667c59535d0 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:56.301118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 703/1417] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:09:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:56.306569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33e37-5770-41fe-ba90-17fac46430c5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:56.307029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33e37-5770-41fe-ba90-17fac46430c5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:56.307136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc33e37-5770-41fe-ba90-17fac46430c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:56.387527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3cc33e37-5770-41fe-ba90-17fac46430c5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:56.388665 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3cc33e37-5770-41fe-ba90-17fac46430c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:56.417806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:56.492570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 715/1418] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:56.646564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad29d-8c45-4cda-b7a1-6667c59535d0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:56.648554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-800ad29d-8c45-4cda-b7a1-6667c59535d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:56.821860 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800ad29d-8c45-4cda-b7a1-6667c59535d0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:56.864832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:56.945165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5a5c6-147e-4d0f-a108-47ec714a37f4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:56.945869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a5c6-147e-4d0f-a108-47ec714a37f4 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:56.946160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a5c6-147e-4d0f-a108-47ec714a37f4 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:56.946430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5a5c6-147e-4d0f-a108-47ec714a37f4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:56.948059 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-28a5a5c6-147e-4d0f-a108-47ec714a37f4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:57.042811 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5a5c6-147e-4d0f-a108-47ec714a37f4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:57.044469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5a5c6-147e-4d0f-a108-47ec714a37f4 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:57.063545 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 704/1419] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:09:57.977615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f875d-115a-4b0a-b7b3-f22124563659 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:57.978295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f875d-115a-4b0a-b7b3-f22124563659 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:57.978295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67f875d-115a-4b0a-b7b3-f22124563659 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:57.979547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 716/1420] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:57.985677 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba0f1-9c29-461b-a6b0-10a560ebba8e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:57.986164 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba0f1-9c29-461b-a6b0-10a560ebba8e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:57.986283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ba0f1-9c29-461b-a6b0-10a560ebba8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:58.048896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:58.197892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d52ba0f1-9c29-461b-a6b0-10a560ebba8e None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:58.199232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d52ba0f1-9c29-461b-a6b0-10a560ebba8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:58.312871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 705/1421] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:09:58.464977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f875d-115a-4b0a-b7b3-f22124563659 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:09:58.466916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e67f875d-115a-4b0a-b7b3-f22124563659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:58.627773 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67f875d-115a-4b0a-b7b3-f22124563659 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:09:58.641562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:58.762410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa1210b-7c98-405d-a9a1-59f13de0e1b5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:09:58.763029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1210b-7c98-405d-a9a1-59f13de0e1b5 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:58.763302 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1210b-7c98-405d-a9a1-59f13de0e1b5 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:58.763569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa1210b-7c98-405d-a9a1-59f13de0e1b5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:58.765168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6aa1210b-7c98-405d-a9a1-59f13de0e1b5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:58.858113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1210b-7c98-405d-a9a1-59f13de0e1b5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:09:58.859740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa1210b-7c98-405d-a9a1-59f13de0e1b5 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:09:58.877973 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 717/1422] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:09:59.749122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871343a3-522e-4942-a9b4-16f7c530fe84 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:59.749746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871343a3-522e-4942-a9b4-16f7c530fe84 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:59.749746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871343a3-522e-4942-a9b4-16f7c530fe84 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:59.751025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 706/1423] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:09:59.756941 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021b0c-ee2d-4a29-9fb5-f99e3cc0263d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:09:59.757720 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021b0c-ee2d-4a29-9fb5-f99e3cc0263d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:09:59.758281 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d021b0c-ee2d-4a29-9fb5-f99e3cc0263d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:09:59.778153 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:09:59.836754 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6d021b0c-ee2d-4a29-9fb5-f99e3cc0263d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:09:59.837956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6d021b0c-ee2d-4a29-9fb5-f99e3cc0263d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:09:59.940417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 718/1424] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:00.095173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871343a3-522e-4942-a9b4-16f7c530fe84 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:00.096600 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-871343a3-522e-4942-a9b4-16f7c530fe84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:00.213305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:00.250447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871343a3-522e-4942-a9b4-16f7c530fe84 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:00.375223 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f035962-d2aa-4f1e-9e21-5843668dac8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:00.375943 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035962-d2aa-4f1e-9e21-5843668dac8e service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:00.376329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035962-d2aa-4f1e-9e21-5843668dac8e service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:00.376678 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035962-d2aa-4f1e-9e21-5843668dac8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:00.379281 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9f035962-d2aa-4f1e-9e21-5843668dac8e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:00.462821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:00.476832 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f035962-d2aa-4f1e-9e21-5843668dac8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:00.478952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f035962-d2aa-4f1e-9e21-5843668dac8e service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:00.497364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 707/1425] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:01.352492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f19c7-22b6-4b3e-9f95-7e55a687a834 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:01.353093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f19c7-22b6-4b3e-9f95-7e55a687a834 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:01.353093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240f19c7-22b6-4b3e-9f95-7e55a687a834 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:01.354449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 719/1426] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:10:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:01.362760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f588b81-c7e9-4829-8e6a-88352fb04055 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:01.363209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f588b81-c7e9-4829-8e6a-88352fb04055 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:01.363312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f588b81-c7e9-4829-8e6a-88352fb04055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:01.445714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0f588b81-c7e9-4829-8e6a-88352fb04055 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:01.446752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0f588b81-c7e9-4829-8e6a-88352fb04055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:01.548563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 708/1427] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:01.705179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f19c7-22b6-4b3e-9f95-7e55a687a834 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:01.707586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-240f19c7-22b6-4b3e-9f95-7e55a687a834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:01.808850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:01.873962 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240f19c7-22b6-4b3e-9f95-7e55a687a834 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:01.990261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0668b0-5e08-48ea-a22e-28e4bbabfe05 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:01.990902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0668b0-5e08-48ea-a22e-28e4bbabfe05 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:01.991145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0668b0-5e08-48ea-a22e-28e4bbabfe05 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:01.991406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0668b0-5e08-48ea-a22e-28e4bbabfe05 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:01.993360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0f0668b0-5e08-48ea-a22e-28e4bbabfe05 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:02.049842 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:02.101980 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0668b0-5e08-48ea-a22e-28e4bbabfe05 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:02.103628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0668b0-5e08-48ea-a22e-28e4bbabfe05 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:02.123215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 720/1428] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:02.934034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292722f-3bb6-42aa-a956-90ca39cbf19f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:02.935017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292722f-3bb6-42aa-a956-90ca39cbf19f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:02.935017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8292722f-3bb6-42aa-a956-90ca39cbf19f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:02.937169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 709/1429] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:10:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:02.942383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c7c8-bfbc-46b4-80dd-289b1e72f8be None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:02.942861 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c7c8-bfbc-46b4-80dd-289b1e72f8be None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:02.942971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03a4c7c8-bfbc-46b4-80dd-289b1e72f8be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:03.023460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-03a4c7c8-bfbc-46b4-80dd-289b1e72f8be None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:03.024651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-03a4c7c8-bfbc-46b4-80dd-289b1e72f8be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:03.149021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 721/1430] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:03.299845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292722f-3bb6-42aa-a956-90ca39cbf19f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:03.301271 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8292722f-3bb6-42aa-a956-90ca39cbf19f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:03.362628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:03.471645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8292722f-3bb6-42aa-a956-90ca39cbf19f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:03.590453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6626220-f094-43eb-a789-154a6053756c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:03.590970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6626220-f094-43eb-a789-154a6053756c service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:03.591248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6626220-f094-43eb-a789-154a6053756c service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:03.591514 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6626220-f094-43eb-a789-154a6053756c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:03.593117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b6626220-f094-43eb-a789-154a6053756c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:03.600239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:03.698730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6626220-f094-43eb-a789-154a6053756c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:03.700326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6626220-f094-43eb-a789-154a6053756c service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:03.718258 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 710/1431] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:04.515766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677280a-8ee6-4de5-8fbb-66aa58c5bed5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:04.516358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677280a-8ee6-4de5-8fbb-66aa58c5bed5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:04.516358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9677280a-8ee6-4de5-8fbb-66aa58c5bed5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:04.517720 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 722/1432] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:04.523763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6750e-f8b2-4dd8-9d01-2b5a4ecdccf9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:04.524442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6750e-f8b2-4dd8-9d01-2b5a4ecdccf9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:04.524609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6750e-f8b2-4dd8-9d01-2b5a4ecdccf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:04.606890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-57c6750e-f8b2-4dd8-9d01-2b5a4ecdccf9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:04.608093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-57c6750e-f8b2-4dd8-9d01-2b5a4ecdccf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:04.691294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:04.721645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 711/1433] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:10:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:04.877266 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677280a-8ee6-4de5-8fbb-66aa58c5bed5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:04.879575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9677280a-8ee6-4de5-8fbb-66aa58c5bed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:04.899042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:05.037158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9677280a-8ee6-4de5-8fbb-66aa58c5bed5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:05.135352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:05.174107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81159c3d-89f1-456f-afe2-32977a7e22dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:05.174819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159c3d-89f1-456f-afe2-32977a7e22dc service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:05.175096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159c3d-89f1-456f-afe2-32977a7e22dc service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:05.175362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81159c3d-89f1-456f-afe2-32977a7e22dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:05.176967 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-81159c3d-89f1-456f-afe2-32977a7e22dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:05.272674 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81159c3d-89f1-456f-afe2-32977a7e22dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:05.274387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81159c3d-89f1-456f-afe2-32977a7e22dc service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:05.293338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 723/1434] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:06.134168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df443628-4dc5-44b5-af7a-306359f3b368 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:06.134732 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df443628-4dc5-44b5-af7a-306359f3b368 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:06.134732 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df443628-4dc5-44b5-af7a-306359f3b368 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:06.135928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 712/1435] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:06.141265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f227-2825-4664-80b7-65967ca47ee0 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:06.142011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f227-2825-4664-80b7-65967ca47ee0 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:06.142011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e8f227-2825-4664-80b7-65967ca47ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:06.253915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-52e8f227-2825-4664-80b7-65967ca47ee0 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:06.255182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-52e8f227-2825-4664-80b7-65967ca47ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:06.301953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:06.378319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 724/1436] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:10:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:06.553657 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df443628-4dc5-44b5-af7a-306359f3b368 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:06.558298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-df443628-4dc5-44b5-af7a-306359f3b368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:06.746476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df443628-4dc5-44b5-af7a-306359f3b368 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:06.814909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:06.897128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944e7fe4-37d8-4f8a-9b7b-70a3049870c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:06.898105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7fe4-37d8-4f8a-9b7b-70a3049870c5 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:06.898554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7fe4-37d8-4f8a-9b7b-70a3049870c5 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:06.898971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944e7fe4-37d8-4f8a-9b7b-70a3049870c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:06.900709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-944e7fe4-37d8-4f8a-9b7b-70a3049870c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:07.015345 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e7fe4-37d8-4f8a-9b7b-70a3049870c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:07.016852 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944e7fe4-37d8-4f8a-9b7b-70a3049870c5 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:07.036122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 713/1437] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:07.836123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb9a16-152c-4c9a-b205-37f2f6d6b865 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:07.836926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb9a16-152c-4c9a-b205-37f2f6d6b865 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:07.837093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb9a16-152c-4c9a-b205-37f2f6d6b865 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:07.839489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 725/1438] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:10:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:07.847746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220b00-8e37-4782-824c-2f8ebe03ede9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:07.848513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220b00-8e37-4782-824c-2f8ebe03ede9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:07.848712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f220b00-8e37-4782-824c-2f8ebe03ede9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:07.945867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1f220b00-8e37-4782-824c-2f8ebe03ede9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:07.947113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1f220b00-8e37-4782-824c-2f8ebe03ede9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:07.949160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:08.051294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 714/1439] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:08.207616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb9a16-152c-4c9a-b205-37f2f6d6b865 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:08.209167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-32bb9a16-152c-4c9a-b205-37f2f6d6b865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:08.368131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb9a16-152c-4c9a-b205-37f2f6d6b865 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:08.394726 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:08.492321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce788145-5719-4f44-a523-39fd6fd1adbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:08.492980 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788145-5719-4f44-a523-39fd6fd1adbf service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:08.493233 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788145-5719-4f44-a523-39fd6fd1adbf service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:08.493472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce788145-5719-4f44-a523-39fd6fd1adbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:08.495133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ce788145-5719-4f44-a523-39fd6fd1adbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:08.596837 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce788145-5719-4f44-a523-39fd6fd1adbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:08.599433 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce788145-5719-4f44-a523-39fd6fd1adbf service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:08.624598 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 726/1440] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:10.585869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e335-7bc8-400d-aedb-0d360ef987eb None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:10.586878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e335-7bc8-400d-aedb-0d360ef987eb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:10.586878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1e335-7bc8-400d-aedb-0d360ef987eb None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:10.589046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 715/1441] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:10.597993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679f3d-bf0b-4c58-864c-989b10ba19e7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:10.598465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679f3d-bf0b-4c58-864c-989b10ba19e7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:10.598581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab679f3d-bf0b-4c58-864c-989b10ba19e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:10.644646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:10.679013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ab679f3d-bf0b-4c58-864c-989b10ba19e7 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:10.680226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ab679f3d-bf0b-4c58-864c-989b10ba19e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:10.906261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 727/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:10.953614 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1e335-7bc8-400d-aedb-0d360ef987eb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:10.955187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c0c1e335-7bc8-400d-aedb-0d360ef987eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:11.067599 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1e335-7bc8-400d-aedb-0d360ef987eb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:11.099802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:11.142772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d637b40f-6fd5-4ef3-9512-d66c13458869 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:11.143317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b40f-6fd5-4ef3-9512-d66c13458869 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:11.143595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b40f-6fd5-4ef3-9512-d66c13458869 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:11.143861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d637b40f-6fd5-4ef3-9512-d66c13458869 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:11.145448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d637b40f-6fd5-4ef3-9512-d66c13458869 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:11.264458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637b40f-6fd5-4ef3-9512-d66c13458869 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:11.265942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d637b40f-6fd5-4ef3-9512-d66c13458869 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:11.287033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 716/1443] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:13.509490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff76f-bd31-468a-b99d-d6acdc9bd76c None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:13.510080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff76f-bd31-468a-b99d-d6acdc9bd76c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:13.510080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73eff76f-bd31-468a-b99d-d6acdc9bd76c None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:13.511417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 728/1444] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:13.517931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5434b6-c12e-4a7e-a8f7-3ad540fbaae5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:13.518700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5434b6-c12e-4a7e-a8f7-3ad540fbaae5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:13.518849 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5434b6-c12e-4a7e-a8f7-3ad540fbaae5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:13.597083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8f5434b6-c12e-4a7e-a8f7-3ad540fbaae5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:13.598361 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8f5434b6-c12e-4a7e-a8f7-3ad540fbaae5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:13.612375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:13.701180 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 717/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:13.743261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff76f-bd31-468a-b99d-d6acdc9bd76c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:13.744821 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-73eff76f-bd31-468a-b99d-d6acdc9bd76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:13.854810 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73eff76f-bd31-468a-b99d-d6acdc9bd76c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:13.873469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:13.938773 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbba4b0-8b54-41aa-b243-b1f2a2de5f4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:13.939373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba4b0-8b54-41aa-b243-b1f2a2de5f4c service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:13.939645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba4b0-8b54-41aa-b243-b1f2a2de5f4c service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:13.939913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbba4b0-8b54-41aa-b243-b1f2a2de5f4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:13.941499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4bbba4b0-8b54-41aa-b243-b1f2a2de5f4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:14.057462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbba4b0-8b54-41aa-b243-b1f2a2de5f4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:14.059048 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbba4b0-8b54-41aa-b243-b1f2a2de5f4c service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:14.077558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 729/1446] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:16.390342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857cdf0-0a2c-41b8-80ae-fe4a867d8691 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:16.390900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857cdf0-0a2c-41b8-80ae-fe4a867d8691 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:16.390900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857cdf0-0a2c-41b8-80ae-fe4a867d8691 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:16.392100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 718/1447] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:16.400928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7f9f-d151-4c0b-9bc3-b873b057f90e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:16.401801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7f9f-d151-4c0b-9bc3-b873b057f90e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:16.401801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c7f9f-d151-4c0b-9bc3-b873b057f90e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:16.461826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:16.481501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0a8c7f9f-d151-4c0b-9bc3-b873b057f90e None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:16.482734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0a8c7f9f-d151-4c0b-9bc3-b873b057f90e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:16.585088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 730/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:16.628338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857cdf0-0a2c-41b8-80ae-fe4a867d8691 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:16.629864 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b857cdf0-0a2c-41b8-80ae-fe4a867d8691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:16.741040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857cdf0-0a2c-41b8-80ae-fe4a867d8691 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:16.782648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:16.818663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19dc5a13-0ff2-4f7f-86bc-d08d86666c3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:16.819278 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5a13-0ff2-4f7f-86bc-d08d86666c3b service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:16.819547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5a13-0ff2-4f7f-86bc-d08d86666c3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:16.819807 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19dc5a13-0ff2-4f7f-86bc-d08d86666c3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:16.821391 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-19dc5a13-0ff2-4f7f-86bc-d08d86666c3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:16.935407 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc5a13-0ff2-4f7f-86bc-d08d86666c3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:16.936847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19dc5a13-0ff2-4f7f-86bc-d08d86666c3b service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:16.955161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 719/1449] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:19.251154 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce7236-6ed8-407b-ac3a-327408d1f617 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:19.251783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce7236-6ed8-407b-ac3a-327408d1f617 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:19.251783 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce7236-6ed8-407b-ac3a-327408d1f617 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:19.253046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 731/1450] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:19.259741 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5f0b3-b8cc-4736-8e45-3e445dba08e3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:19.260547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5f0b3-b8cc-4736-8e45-3e445dba08e3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:19.260547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c5f0b3-b8cc-4736-8e45-3e445dba08e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:19.344525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e5c5f0b3-b8cc-4736-8e45-3e445dba08e3 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:19.345747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e5c5f0b3-b8cc-4736-8e45-3e445dba08e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:19.368330 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:19.460139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 720/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:19.504920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce7236-6ed8-407b-ac3a-327408d1f617 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:19.507404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-08ce7236-6ed8-407b-ac3a-327408d1f617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:19.623454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce7236-6ed8-407b-ac3a-327408d1f617 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:19.645873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:19.700172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a188b7c-f034-4ffe-8f7d-bd73c953953b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:19.700777 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a188b7c-f034-4ffe-8f7d-bd73c953953b service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:19.701053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a188b7c-f034-4ffe-8f7d-bd73c953953b service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:19.701323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a188b7c-f034-4ffe-8f7d-bd73c953953b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:19.702960 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6a188b7c-f034-4ffe-8f7d-bd73c953953b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:19.815698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a188b7c-f034-4ffe-8f7d-bd73c953953b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:19.817139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a188b7c-f034-4ffe-8f7d-bd73c953953b service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:19.835670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 732/1452] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:21.877631 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395301f-7722-4bb9-8c67-2f63d03da36d None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:21.878253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395301f-7722-4bb9-8c67-2f63d03da36d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:21.878253 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3395301f-7722-4bb9-8c67-2f63d03da36d None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:21.880337 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 721/1453] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:21 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:21.888623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2db9a-09f8-4682-a2ec-c0b110658213 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:21.889054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2db9a-09f8-4682-a2ec-c0b110658213 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:21.889186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f2db9a-09f8-4682-a2ec-c0b110658213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:21.963785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:21.966593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b7f2db9a-09f8-4682-a2ec-c0b110658213 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:21.968155 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b7f2db9a-09f8-4682-a2ec-c0b110658213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:22.080269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 733/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:22.119902 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395301f-7722-4bb9-8c67-2f63d03da36d None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:22.121487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3395301f-7722-4bb9-8c67-2f63d03da36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:22.234291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3395301f-7722-4bb9-8c67-2f63d03da36d None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:22.302417 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:22.339132 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe479557-9fe0-4e1d-b22e-6c720d9139cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:22.339758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479557-9fe0-4e1d-b22e-6c720d9139cf service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:22.340034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479557-9fe0-4e1d-b22e-6c720d9139cf service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:22.340299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe479557-9fe0-4e1d-b22e-6c720d9139cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:22.341900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fe479557-9fe0-4e1d-b22e-6c720d9139cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:22.457724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe479557-9fe0-4e1d-b22e-6c720d9139cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:22.459200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe479557-9fe0-4e1d-b22e-6c720d9139cf service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:22.477696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 722/1455] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:24.519949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca279-a532-4f50-bcd5-98581b8e929f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:24.520554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca279-a532-4f50-bcd5-98581b8e929f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:24.520554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dca279-a532-4f50-bcd5-98581b8e929f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:24.521841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 734/1456] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:24.528027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6db3-c908-46df-b912-3e7add07e694 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:24.528475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6db3-c908-46df-b912-3e7add07e694 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:24.528584 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f6db3-c908-46df-b912-3e7add07e694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:24.601144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-cd7f6db3-c908-46df-b912-3e7add07e694 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:24.602394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-cd7f6db3-c908-46df-b912-3e7add07e694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:24.632663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:24.711502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 723/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:24.762143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca279-a532-4f50-bcd5-98581b8e929f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:24.763745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e6dca279-a532-4f50-bcd5-98581b8e929f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:24.878447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dca279-a532-4f50-bcd5-98581b8e929f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:24.914286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:24.961757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e176f05e-da4f-4f32-9473-3588d134c172 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:24.962318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f05e-da4f-4f32-9473-3588d134c172 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:24.962589 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f05e-da4f-4f32-9473-3588d134c172 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:24.962848 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e176f05e-da4f-4f32-9473-3588d134c172 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:24.964466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e176f05e-da4f-4f32-9473-3588d134c172 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:25.085839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f05e-da4f-4f32-9473-3588d134c172 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:25.087320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e176f05e-da4f-4f32-9473-3588d134c172 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:25.106684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 735/1458] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:27.153460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df670480-4751-4fb4-a70b-33d18b8bca61 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:27.154311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df670480-4751-4fb4-a70b-33d18b8bca61 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:27.154507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df670480-4751-4fb4-a70b-33d18b8bca61 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:27.156548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 724/1459] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:27 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:27.165388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ba84-5c28-4a49-b822-154ed8a67407 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:27.166181 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ba84-5c28-4a49-b822-154ed8a67407 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:27.166369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb4ba84-5c28-4a49-b822-154ed8a67407 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:27.238348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-7fb4ba84-5c28-4a49-b822-154ed8a67407 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:27.239571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7fb4ba84-5c28-4a49-b822-154ed8a67407 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:27.248570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:27.343138 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 736/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:27.384503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df670480-4751-4fb4-a70b-33d18b8bca61 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:27.387019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-df670480-4751-4fb4-a70b-33d18b8bca61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:27.501249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df670480-4751-4fb4-a70b-33d18b8bca61 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:27.559169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:27.588982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7aeeb95-2d37-4bb3-a9ac-766bb9475925 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:27.589847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeeb95-2d37-4bb3-a9ac-766bb9475925 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:27.590145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeeb95-2d37-4bb3-a9ac-766bb9475925 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:27.590412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7aeeb95-2d37-4bb3-a9ac-766bb9475925 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:27.591991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d7aeeb95-2d37-4bb3-a9ac-766bb9475925 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:27.721295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeeb95-2d37-4bb3-a9ac-766bb9475925 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:27.722766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7aeeb95-2d37-4bb3-a9ac-766bb9475925 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:27.741045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 725/1461] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:29.819397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda226b-7bdd-4ce0-9737-fd2140e7ac7e None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:29.820284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda226b-7bdd-4ce0-9737-fd2140e7ac7e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:29.820284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fda226b-7bdd-4ce0-9737-fd2140e7ac7e None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:29.822263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 737/1462] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:29.828571 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc610-fc83-4322-949d-c557decd8b8f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:29.829065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc610-fc83-4322-949d-c557decd8b8f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:29.829065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37dc610-fc83-4322-949d-c557decd8b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:29.909897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e37dc610-fc83-4322-949d-c557decd8b8f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:29.911700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e37dc610-fc83-4322-949d-c557decd8b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:29.956492 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:30.020194 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 726/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:30.061227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda226b-7bdd-4ce0-9737-fd2140e7ac7e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:30.062846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2fda226b-7bdd-4ce0-9737-fd2140e7ac7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:30.177738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fda226b-7bdd-4ce0-9737-fd2140e7ac7e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:30.217236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:30.259915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f020bf6b-1aee-45e2-bde8-a04cbffc9123 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:30.260529 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bf6b-1aee-45e2-bde8-a04cbffc9123 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:30.260804 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bf6b-1aee-45e2-bde8-a04cbffc9123 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:30.261075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f020bf6b-1aee-45e2-bde8-a04cbffc9123 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:30.262759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f020bf6b-1aee-45e2-bde8-a04cbffc9123 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:30.389267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bf6b-1aee-45e2-bde8-a04cbffc9123 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:30.390674 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f020bf6b-1aee-45e2-bde8-a04cbffc9123 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:30.409635 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 738/1464] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:32.466816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb787095-0018-46ef-ba99-f64069be1a58 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:32.467388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb787095-0018-46ef-ba99-f64069be1a58 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:32.467388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb787095-0018-46ef-ba99-f64069be1a58 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:32.468612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 727/1465] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:32.475146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cea5d-5a94-4546-8f61-6e07736b9078 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:32.475823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cea5d-5a94-4546-8f61-6e07736b9078 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:32.475977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531cea5d-5a94-4546-8f61-6e07736b9078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:32.556117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-531cea5d-5a94-4546-8f61-6e07736b9078 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:32.557319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-531cea5d-5a94-4546-8f61-6e07736b9078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:32.576079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:32.668779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 739/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:32.709699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb787095-0018-46ef-ba99-f64069be1a58 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:32.712362 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fb787095-0018-46ef-ba99-f64069be1a58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:32.834339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb787095-0018-46ef-ba99-f64069be1a58 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:32.911016 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:32.920395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ddcbe-d525-4940-9078-da2c137e8a75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:32.920998 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ddcbe-d525-4940-9078-da2c137e8a75 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:32.921270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ddcbe-d525-4940-9078-da2c137e8a75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:32.921531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ddcbe-d525-4940-9078-da2c137e8a75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:32.923151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7a3ddcbe-d525-4940-9078-da2c137e8a75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:33.040862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ddcbe-d525-4940-9078-da2c137e8a75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:33.042241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ddcbe-d525-4940-9078-da2c137e8a75 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:33.060726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 728/1467] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:35.101073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218e6d-c8b4-4bc1-87e7-890205543046 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:35.101656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218e6d-c8b4-4bc1-87e7-890205543046 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:35.101656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2218e6d-c8b4-4bc1-87e7-890205543046 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:35.103605 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 740/1468] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:35.110227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009827f-22a3-4e4e-9911-13e42b5ecd7f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:35.110699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009827f-22a3-4e4e-9911-13e42b5ecd7f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:35.110806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009827f-22a3-4e4e-9911-13e42b5ecd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:35.182399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0009827f-22a3-4e4e-9911-13e42b5ecd7f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:35.183612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0009827f-22a3-4e4e-9911-13e42b5ecd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:35.233051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:35.284341 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 729/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:35.322948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218e6d-c8b4-4bc1-87e7-890205543046 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:35.325486 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f2218e6d-c8b4-4bc1-87e7-890205543046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:35.453826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2218e6d-c8b4-4bc1-87e7-890205543046 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:35.503876 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:35.541389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f479ac-5171-4775-acf3-4d32f23e357d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:35.541995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f479ac-5171-4775-acf3-4d32f23e357d service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:35.542297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f479ac-5171-4775-acf3-4d32f23e357d service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:35.542563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f479ac-5171-4775-acf3-4d32f23e357d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:35.544702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-17f479ac-5171-4775-acf3-4d32f23e357d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:35.667577 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f479ac-5171-4775-acf3-4d32f23e357d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:35.669359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f479ac-5171-4775-acf3-4d32f23e357d service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:35.689726 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 741/1470] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:45.282526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=22 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:45.686796 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=66 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:55.285559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f740-c73b-4cf2-b74e-822ab65dcf0c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:55.286642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f740-c73b-4cf2-b74e-822ab65dcf0c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:55.286642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405f740-c73b-4cf2-b74e-822ab65dcf0c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:55.288583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 730/1471] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:10:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:55.297761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45b9c-9e80-4204-b0a5-bd179e531423 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:55.298254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45b9c-9e80-4204-b0a5-bd179e531423 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:55.298365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c45b9c-9e80-4204-b0a5-bd179e531423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:55.370852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-36c45b9c-9e80-4204-b0a5-bd179e531423 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:55.372111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-36c45b9c-9e80-4204-b0a5-bd179e531423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:55.481384 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 742/1472] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:55.572146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc9dd4-1c27-4e3d-b22f-d783122e0351 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:55.572430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc9dd4-1c27-4e3d-b22f-d783122e0351 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:55.572703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adc9dd4-1c27-4e3d-b22f-d783122e0351 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:55.574079 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 731/1473] 10.222.0.39 () {54 vars in 966 bytes} [Mon Aug 8 01:10:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:55.579389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9152-7678-414f-be74-12ef2c56fd96 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:55.579778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9152-7678-414f-be74-12ef2c56fd96 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:55.580049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74d9152-7678-414f-be74-12ef2c56fd96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:55.656215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a74d9152-7678-414f-be74-12ef2c56fd96 None None] MFA Rules not processed for user `74ee9575f99d40b88236d82f14780260`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:55.657327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a74d9152-7678-414f-be74-12ef2c56fd96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:55.678524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:55.741644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 743/1474] 10.222.0.39 () {58 vars in 1063 bytes} [Mon Aug 8 01:10:55 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:10:55.749533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc9dd4-1c27-4e3d-b22f-d783122e0351 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:55.751100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2adc9dd4-1c27-4e3d-b22f-d783122e0351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:55.861458 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adc9dd4-1c27-4e3d-b22f-d783122e0351 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:55.945133 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee21f2-1771-4d2e-ac48-0a510d0b13a0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '74ee9575f99d40b88236d82f14780260', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:55.945648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee21f2-1771-4d2e-ac48-0a510d0b13a0 service glance] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:55.945891 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee21f2-1771-4d2e-ac48-0a510d0b13a0 service glance] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:55.946184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee21f2-1771-4d2e-ac48-0a510d0b13a0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:55.947755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-97ee21f2-1771-4d2e-ac48-0a510d0b13a0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:56.002441 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:56.069302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee21f2-1771-4d2e-ac48-0a510d0b13a0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:56.070779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ee21f2-1771-4d2e-ac48-0a510d0b13a0 service glance] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:56.090439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 732/1475] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:10:58.168391 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d3758-3a93-47c8-a6e5-658d85e81fe2 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:58.169264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d3758-3a93-47c8-a6e5-658d85e81fe2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:58.169264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964d3758-3a93-47c8-a6e5-658d85e81fe2 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:58.172870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 744/1476] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:10:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:10:58.180714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59593-bd26-43d9-b6da-c77d604ce1ff None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:58.181177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59593-bd26-43d9-b6da-c77d604ce1ff None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:58.181282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc59593-bd26-43d9-b6da-c77d604ce1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:58.255819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3bc59593-bd26-43d9-b6da-c77d604ce1ff None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:10:58.257033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3bc59593-bd26-43d9-b6da-c77d604ce1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:58.358030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 733/1477] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:10:58.381161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d3758-3a93-47c8-a6e5-658d85e81fe2 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:10:58.382633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-964d3758-3a93-47c8-a6e5-658d85e81fe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:10:58.516695 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964d3758-3a93-47c8-a6e5-658d85e81fe2 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:10:58.566332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:10:58.612046 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befb160b-6003-4f88-b2aa-df9f9b4ffd94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:10:58.612647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb160b-6003-4f88-b2aa-df9f9b4ffd94 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:10:58.612917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb160b-6003-4f88-b2aa-df9f9b4ffd94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:10:58.613182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befb160b-6003-4f88-b2aa-df9f9b4ffd94 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:10:58.613806 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb160b-6003-4f88-b2aa-df9f9b4ffd94 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:10:58.615587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-befb160b-6003-4f88-b2aa-df9f9b4ffd94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:10:58.615587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:10:58.615587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:10:58.616701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befb160b-6003-4f88-b2aa-df9f9b4ffd94 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:10:58.641834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 745/1478] 10.222.0.39 () {56 vars in 1108 bytes} [Mon Aug 8 01:10:58 2022] GET /identity/v3/projects => generated 2553 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:11:00.647098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ff1d7-5bfb-46cd-82ee-8309d9e42bcd None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:00.647970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ff1d7-5bfb-46cd-82ee-8309d9e42bcd None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:00.647970 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240ff1d7-5bfb-46cd-82ee-8309d9e42bcd None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:00.650217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 734/1479] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:11:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:11:00.657286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f641f8-bbf6-4ae9-8514-4fb84b78022d None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:00.658021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f641f8-bbf6-4ae9-8514-4fb84b78022d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:00.658308 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f641f8-bbf6-4ae9-8514-4fb84b78022d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:00.745569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c1f641f8-bbf6-4ae9-8514-4fb84b78022d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:11:00.746822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c1f641f8-bbf6-4ae9-8514-4fb84b78022d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:00.847680 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 746/1480] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:11:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:11:00.894336 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ff1d7-5bfb-46cd-82ee-8309d9e42bcd None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:11:00.895966 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-240ff1d7-5bfb-46cd-82ee-8309d9e42bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:00.906424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:01.049749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240ff1d7-5bfb-46cd-82ee-8309d9e42bcd None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:11:01.136835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:01.173552 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7d120e-9e26-49d7-8bcd-a34b88358a72 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:11:01.174515 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d120e-9e26-49d7-8bcd-a34b88358a72 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:01.174788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d120e-9e26-49d7-8bcd-a34b88358a72 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:01.175053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7d120e-9e26-49d7-8bcd-a34b88358a72 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:01.176653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5f7d120e-9e26-49d7-8bcd-a34b88358a72 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:01.282773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d120e-9e26-49d7-8bcd-a34b88358a72 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:11:01.284444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7d120e-9e26-49d7-8bcd-a34b88358a72 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:11:01.303563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 735/1481] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:11:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:11:03.490677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62423c5-4716-47d6-9cf4-ab0fec506507 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:03.491264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62423c5-4716-47d6-9cf4-ab0fec506507 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:03.491264 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62423c5-4716-47d6-9cf4-ab0fec506507 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:03.492608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 747/1482] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:11:03.498268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10051c-bb72-4965-8448-b62b39d4ec17 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:03.498724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10051c-bb72-4965-8448-b62b39d4ec17 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:03.498837 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd10051c-bb72-4965-8448-b62b39d4ec17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:03.568720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-dd10051c-bb72-4965-8448-b62b39d4ec17 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:11:03.569930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dd10051c-bb72-4965-8448-b62b39d4ec17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:03.620089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:03.676039 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 736/1483] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:11:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:11:03.716750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62423c5-4716-47d6-9cf4-ab0fec506507 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:11:03.719262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f62423c5-4716-47d6-9cf4-ab0fec506507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:03.750218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:03.837757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62423c5-4716-47d6-9cf4-ab0fec506507 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:11:03.925294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691504fc-3e22-4b3c-be00-dbc294928739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:11:03.925906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691504fc-3e22-4b3c-be00-dbc294928739 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:03.926216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691504fc-3e22-4b3c-be00-dbc294928739 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:03.926484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691504fc-3e22-4b3c-be00-dbc294928739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:03.928106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-691504fc-3e22-4b3c-be00-dbc294928739 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:04.013902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:04.052699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691504fc-3e22-4b3c-be00-dbc294928739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:11:04.054170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691504fc-3e22-4b3c-be00-dbc294928739 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:11:04.073163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 748/1484] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:11:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:11:06.146373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad276-5a9d-4635-9be8-634c431259a4 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:06.146989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad276-5a9d-4635-9be8-634c431259a4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:06.146989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128ad276-5a9d-4635-9be8-634c431259a4 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:06.148274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 737/1485] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:11:06.154503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ab88-5a55-462e-a9e9-329decf319c5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:06.154958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ab88-5a55-462e-a9e9-329decf319c5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:06.155065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50ab88-5a55-462e-a9e9-329decf319c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:06.244900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ec50ab88-5a55-462e-a9e9-329decf319c5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:11:06.246158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ec50ab88-5a55-462e-a9e9-329decf319c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:06.346488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 749/1486] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:11:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:11:06.400353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ad276-5a9d-4635-9be8-634c431259a4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:11:06.402890 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-128ad276-5a9d-4635-9be8-634c431259a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:06.526643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128ad276-5a9d-4635-9be8-634c431259a4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:11:06.603240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:06.605359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8054bf-0fc3-4055-840c-4790cc9d74f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:11:06.606102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8054bf-0fc3-4055-840c-4790cc9d74f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:06.606268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8054bf-0fc3-4055-840c-4790cc9d74f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:06.606551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8054bf-0fc3-4055-840c-4790cc9d74f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:06.608911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6a8054bf-0fc3-4055-840c-4790cc9d74f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:06.724443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8054bf-0fc3-4055-840c-4790cc9d74f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:11:06.725874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8054bf-0fc3-4055-840c-4790cc9d74f6 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:11:06.747424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 738/1487] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:11:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:11:08.984721 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1401-4a37-4451-a156-d259b512c314 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:08.985627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1401-4a37-4451-a156-d259b512c314 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:08.985627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b1401-4a37-4451-a156-d259b512c314 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:08.989310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 750/1488] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:11:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:11:08.997365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda1e8-156b-45bc-87fb-de16551ffbfe None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:08.997833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda1e8-156b-45bc-87fb-de16551ffbfe None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:08.997942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fda1e8-156b-45bc-87fb-de16551ffbfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:09.077381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-26fda1e8-156b-45bc-87fb-de16551ffbfe None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:11:09.078908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-26fda1e8-156b-45bc-87fb-de16551ffbfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:09.138772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:09.184362 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 739/1489] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:11:09.228625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1401-4a37-4451-a156-d259b512c314 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:11:09.231097 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-768b1401-4a37-4451-a156-d259b512c314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:09.282644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:09.373009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b1401-4a37-4451-a156-d259b512c314 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:11:09.455521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55990a-6117-4a3b-bfd9-b294194c90c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:11:09.456120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55990a-6117-4a3b-bfd9-b294194c90c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:09.456400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55990a-6117-4a3b-bfd9-b294194c90c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:09.456663 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55990a-6117-4a3b-bfd9-b294194c90c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:09.458300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4b55990a-6117-4a3b-bfd9-b294194c90c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:09.549863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:09.581738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55990a-6117-4a3b-bfd9-b294194c90c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:11:09.583268 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55990a-6117-4a3b-bfd9-b294194c90c6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:11:09.602652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 751/1490] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:11:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:11:11.785725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61569-35a8-4796-912a-17c17e40a51c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:11.786390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61569-35a8-4796-912a-17c17e40a51c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:11.786390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c61569-35a8-4796-912a-17c17e40a51c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:11.787883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 740/1491] 10.222.0.39 () {54 vars in 927 bytes} [Mon Aug 8 01:11:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:11:11.793329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4145-772d-4ec4-9521-29bc82dd1762 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:11.793773 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4145-772d-4ec4-9521-29bc82dd1762 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:11.793891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdec4145-772d-4ec4-9521-29bc82dd1762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:11.865338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-cdec4145-772d-4ec4-9521-29bc82dd1762 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:11:11.866587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cdec4145-772d-4ec4-9521-29bc82dd1762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:11.961581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 752/1492] 10.222.0.39 () {58 vars in 1024 bytes} [Mon Aug 8 01:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:11:12.004094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c61569-35a8-4796-912a-17c17e40a51c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:11:12.006474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-96c61569-35a8-4796-912a-17c17e40a51c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:12.124088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c61569-35a8-4796-912a-17c17e40a51c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:11:12.203938 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abaa71b4-606d-4dbc-9966-5014da1a9705 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:11:12.204862 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa71b4-606d-4dbc-9966-5014da1a9705 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:11:12.205281 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa71b4-606d-4dbc-9966-5014da1a9705 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:11:12.205700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abaa71b4-606d-4dbc-9966-5014da1a9705 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:11:12.207829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-abaa71b4-606d-4dbc-9966-5014da1a9705 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:11:12.217269 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:12.326248 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa71b4-606d-4dbc-9966-5014da1a9705 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:11:12.327700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abaa71b4-606d-4dbc-9966-5014da1a9705 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:11:12.347105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 741/1493] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:11:21.959802 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=82 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:11:22.344426 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=50 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:22.902869 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:22.903496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:22.903496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:22.982925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:12:22.984141 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:23.082820 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 753/1494] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:12:23.091470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8532ff0-fd36-476a-a5e8-3e23f735c384 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:23.091997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8532ff0-fd36-476a-a5e8-3e23f735c384 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:23.091997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8532ff0-fd36-476a-a5e8-3e23f735c384 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:23.182651 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-c8532ff0-fd36-476a-a5e8-3e23f735c384 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:12:23.183878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c8532ff0-fd36-476a-a5e8-3e23f735c384 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:23.286229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 742/1495] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:12:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:12:23.291750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:23.292990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:23.306446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd045c0-7a20-474a-bbe7-953638e79a67 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:23.377939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:23.416143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:23.416753 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:23.417026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:23.417292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:23.417928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:12:23.418249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:23.419269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:23.419269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:12:23.419269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:12:23.420150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:23.432253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 754/1496] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:12:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:12:23.440853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8532ff0-fd36-476a-a5e8-3e23f735c384 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:23.450475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8532ff0-fd36-476a-a5e8-3e23f735c384 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:23.514911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:23.550202 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:23.550849 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:23.551121 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:23.551386 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:23.552005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:23.553730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:23.553730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Aug 08 01:12:23.553730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: Aug 08 01:12:23.554950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:23.619192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 743/1497] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:12:23 2022] POST /identity/v3/projects => generated 379 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:12:23.625517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:23.627117 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:23.662713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae06563-7e2c-4125-a63f-eef1fcbd0831 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:23.760855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:23.761451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:23.761727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:23.761993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:23.762630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:23.763648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:23.763648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:12:23.763648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:12:23.764841 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:23.808725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 755/1498] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:12:23 2022] POST /identity/v3/users => generated 290 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:12:23.813138 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:23.814757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:23.880087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee2b4c0-1b4d-40fb-bc20-76f260f02edd admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:23.966861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:23.978263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:23.978872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:23.979141 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:23.979400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:23.980032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:23.981035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:23.981035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Aug 08 01:12:23.981035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: Aug 08 01:12:23.981905 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:23.994125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 744/1499] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:12:23.998407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:23.999910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:24.011388 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c195286-4182-477c-bb72-fe7c54f6f47c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:24.039001 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:24.114890 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d8081-916f-4a25-932a-aa048035dae7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:24.115697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8081-916f-4a25-932a-aa048035dae7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:24.115970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8081-916f-4a25-932a-aa048035dae7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:24.116230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d8081-916f-4a25-932a-aa048035dae7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:24.116880 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8081-916f-4a25-932a-aa048035dae7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:24.117902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-515d8081-916f-4a25-932a-aa048035dae7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:24.117902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:12:24.117902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:12:24.118814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d8081-916f-4a25-932a-aa048035dae7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:24.132091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 756/1500] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:12:23 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:12:24.136486 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:24.138106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:24.173696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fa3ea6-6aa2-42ff-b7bb-d76ddaf7dc85 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:24.283420 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3342b38d-7cdd-44f8-b16e-e17a0eaa108f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:24.284089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342b38d-7cdd-44f8-b16e-e17a0eaa108f admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:24.284396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342b38d-7cdd-44f8-b16e-e17a0eaa108f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:24.284672 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3342b38d-7cdd-44f8-b16e-e17a0eaa108f admin admin] PATH_INFO: `/v3/projects/8e733070dd3c42319847cf589f3df0b2/users/00c673858fed4c2cbb93b2e476515bfc/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:24.312685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342b38d-7cdd-44f8-b16e-e17a0eaa108f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e733070dd3c42319847cf589f3df0b2, user_id=00c673858fed4c2cbb93b2e476515bfc, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:24.313705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-3342b38d-7cdd-44f8-b16e-e17a0eaa108f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:24.313705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Aug 08 01:12:24.313705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: Aug 08 01:12:24.316074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3342b38d-7cdd-44f8-b16e-e17a0eaa108f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:24.342465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 745/1501] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:12:24 2022] PUT /identity/v3/projects/8e733070dd3c42319847cf589f3df0b2/users/00c673858fed4c2cbb93b2e476515bfc/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:12:24.355862 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb689-8eb5-4e96-a7f3-bda3b13c9064 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:24.356229 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb689-8eb5-4e96-a7f3-bda3b13c9064 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:24.356582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07acb689-8eb5-4e96-a7f3-bda3b13c9064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:24.423463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-07acb689-8eb5-4e96-a7f3-bda3b13c9064 None None] MFA Rules not processed for user `00c673858fed4c2cbb93b2e476515bfc`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:12:24.424678 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-07acb689-8eb5-4e96-a7f3-bda3b13c9064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:24.505059 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 757/1502] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:12:24.521999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03df40-ac50-47f1-b8cc-a75c732b2670 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:24.522311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03df40-ac50-47f1-b8cc-a75c732b2670 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:24.522588 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e03df40-ac50-47f1-b8cc-a75c732b2670 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:24.523924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 746/1503] 10.222.0.39 () {54 vars in 964 bytes} [Mon Aug 8 01:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:12:24.530646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9886-b7b2-438e-a4b6-4e4c691bd0d6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:24.530930 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9886-b7b2-438e-a4b6-4e4c691bd0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:24.531204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42e9886-b7b2-438e-a4b6-4e4c691bd0d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:24.569381 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:24.619289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a42e9886-b7b2-438e-a4b6-4e4c691bd0d6 None None] MFA Rules not processed for user `a043a385f94e4aef84280c4a1533da28`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:12:24.620509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a42e9886-b7b2-438e-a4b6-4e4c691bd0d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:24.711050 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 758/1504] 10.222.0.39 () {58 vars in 1061 bytes} [Mon Aug 8 01:12:24 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:12:24.719201 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03df40-ac50-47f1-b8cc-a75c732b2670 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:24.720724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3e03df40-ac50-47f1-b8cc-a75c732b2670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:24.773593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:24.839689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e03df40-ac50-47f1-b8cc-a75c732b2670 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:24.922440 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:24.923272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:24.923604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:24.923968 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:24.926436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:25.045688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:25.047173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:25.051110 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:25.066800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 747/1505] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:12:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:12:25.113015 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07039-9574-44b5-856b-f757fa9b81ce None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:25.113497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07039-9574-44b5-856b-f757fa9b81ce None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:25.113605 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd07039-9574-44b5-856b-f757fa9b81ce None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:25.114873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 759/1506] 10.222.0.39 () {52 vars in 830 bytes} [Mon Aug 8 01:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:12:25.118774 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:25.120009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:25.223466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1ee2a7-e050-4b3e-bb87-1118a6d0e838 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:25.334012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:25.334697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:25.334971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:25.335235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] PATH_INFO: `/v3/users/00c673858fed4c2cbb93b2e476515bfc` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:25.347930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00c673858fed4c2cbb93b2e476515bfc)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:25.348884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:25.348884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Aug 08 01:12:25.348884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: Aug 08 01:12:25.350221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:25.360013 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:25.420510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00c673858fed4c2cbb93b2e476515bfc'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:25.432148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00c673858fed4c2cbb93b2e476515bfc'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:25.448099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00c673858fed4c2cbb93b2e476515bfc'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:25.473108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00c673858fed4c2cbb93b2e476515bfc'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:25.473665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00c673858fed4c2cbb93b2e476515bfc'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:25.479581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 748/1507] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:12:25 2022] DELETE /identity/v3/users/00c673858fed4c2cbb93b2e476515bfc => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:12:25.484168 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:25.484452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:25.484730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:25.541205 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:12:25.542454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:25.619416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:25.637068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 760/1508] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:12:25.649590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:25.650879 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:25.765682 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0bd1d-b05c-499f-b0a9-2d50d360da17 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:25.832435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:25.853191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82017f8-df42-41ec-a04e-aa6ada869bdb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:25.853805 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82017f8-df42-41ec-a04e-aa6ada869bdb service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:25.854062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82017f8-df42-41ec-a04e-aa6ada869bdb service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:25.854381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82017f8-df42-41ec-a04e-aa6ada869bdb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:25.855962 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b82017f8-df42-41ec-a04e-aa6ada869bdb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:25.981461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82017f8-df42-41ec-a04e-aa6ada869bdb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:25.982936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82017f8-df42-41ec-a04e-aa6ada869bdb service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:26.002354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 749/1509] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:12:26.447595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:12:26.448903 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:12:26.460856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3ef4d7-8cdb-4fe3-9044-839d242a0392 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:12:26.560470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:12:26.561032 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:12:26.561309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:12:26.561617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] PATH_INFO: `/v3/projects/8e733070dd3c42319847cf589f3df0b2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:12:26.571855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e733070dd3c42319847cf589f3df0b2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:12:26.572898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:12:26.572898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:12:26.572898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:12:26.574109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:12:26.638167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e733070dd3c42319847cf589f3df0b2', 'request_id': 'req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:26.644391 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e733070dd3c42319847cf589f3df0b2', 'request_id': 'req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:26.657951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e733070dd3c42319847cf589f3df0b2', 'request_id': 'req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:26.692998 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] The token cache is being invalidate because project 8e733070dd3c42319847cf589f3df0b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:12:26.693303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:26.693879 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-a8a197ba-e0a3-4be0-a108-a6bbf10f8bf5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:12:26.695213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 761/1510] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:12:26 2022] DELETE /identity/v3/projects/8e733070dd3c42319847cf589f3df0b2 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:12:35.999824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=62 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:12:36.690800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:13:51.754278 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6135a6-5dc9-46f8-a959-28756063d1e9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:51.754923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6135a6-5dc9-46f8-a959-28756063d1e9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:51.754923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6135a6-5dc9-46f8-a959-28756063d1e9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:51.756144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 750/1511] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:13:51.762313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e986a4-4910-42fa-b1e6-571c8c8fa3e4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:51.763075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e986a4-4910-42fa-b1e6-571c8c8fa3e4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:51.763249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e986a4-4910-42fa-b1e6-571c8c8fa3e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:51.861881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-08e986a4-4910-42fa-b1e6-571c8c8fa3e4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:13:51.863114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-08e986a4-4910-42fa-b1e6-571c8c8fa3e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:13:51.978719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 762/1512] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:13:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:13:52.141954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6135a6-5dc9-46f8-a959-28756063d1e9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:13:52.145311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ee6135a6-5dc9-46f8-a959-28756063d1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:13:52.279909 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6135a6-5dc9-46f8-a959-28756063d1e9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:13:52.285813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f6f477-3779-4189-8b58-7209f4e4a94a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:13:52.286461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f477-3779-4189-8b58-7209f4e4a94a service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:52.286743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f477-3779-4189-8b58-7209f4e4a94a service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:52.287014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f6f477-3779-4189-8b58-7209f4e4a94a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:52.297022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6f477-3779-4189-8b58-7209f4e4a94a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:13:52.299643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f6f477-3779-4189-8b58-7209f4e4a94a service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:13:52.312797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 751/1513] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:13:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:13:53.164109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccf716-2119-4a33-bf41-e69917fae473 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:53.164683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccf716-2119-4a33-bf41-e69917fae473 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:53.164683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccf716-2119-4a33-bf41-e69917fae473 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:53.165915 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 763/1514] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:13:53.171683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95f4c-02b0-4453-abdc-31b088e96692 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:53.172145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95f4c-02b0-4453-abdc-31b088e96692 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:53.172261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e95f4c-02b0-4453-abdc-31b088e96692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:53.199299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-04e95f4c-02b0-4453-abdc-31b088e96692 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:13:53.200500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-04e95f4c-02b0-4453-abdc-31b088e96692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:13:53.209607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 752/1515] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:13:53.371840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccf716-2119-4a33-bf41-e69917fae473 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:13:53.395201 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccf716-2119-4a33-bf41-e69917fae473 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:13:53.403300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a4128f-db7f-4a33-802a-0910ddec08a5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:13:53.403933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4128f-db7f-4a33-802a-0910ddec08a5 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:53.404223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4128f-db7f-4a33-802a-0910ddec08a5 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:53.404536 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a4128f-db7f-4a33-802a-0910ddec08a5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:53.413764 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4128f-db7f-4a33-802a-0910ddec08a5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:13:53.415535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a4128f-db7f-4a33-802a-0910ddec08a5 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:13:53.425637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 764/1516] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:13:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:13:53.596142 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252264f-12e4-4112-ade6-2f2018398fe3 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:53.596414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252264f-12e4-4112-ade6-2f2018398fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:53.596691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f252264f-12e4-4112-ade6-2f2018398fe3 None None] PATH_INFO: `/v3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:53.598025 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 753/1517] 10.222.0.43 () {54 vars in 925 bytes} [Mon Aug 8 01:13:53 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:13:53.605816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500974db-b863-4139-945c-ed96764f32e2 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:13:53.606131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500974db-b863-4139-945c-ed96764f32e2 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:13:53.606402 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500974db-b863-4139-945c-ed96764f32e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:13:53.669318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-500974db-b863-4139-945c-ed96764f32e2 None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:13:53.670489 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-500974db-b863-4139-945c-ed96764f32e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:13:53.688353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:13:53.746737 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 765/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Aug 8 01:13:53 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:14:02.813137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f595-8855-40f3-9af0-d9aa4edb235f None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:02.813733 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f595-8855-40f3-9af0-d9aa4edb235f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:02.813733 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5220f595-8855-40f3-9af0-d9aa4edb235f None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:02.814946 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 754/1519] 10.222.0.39 () {54 vars in 961 bytes} [Mon Aug 8 01:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:14:02.821166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457c94-05b0-4267-8765-00f9e4113739 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:02.821867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457c94-05b0-4267-8765-00f9e4113739 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:02.822103 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55457c94-05b0-4267-8765-00f9e4113739 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:02.844672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-55457c94-05b0-4267-8765-00f9e4113739 None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:14:02.845844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-55457c94-05b0-4267-8765-00f9e4113739 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:02.855493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 766/1520] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Aug 8 01:14:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:14:02.863054 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f595-8855-40f3-9af0-d9aa4edb235f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:14:02.877082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5220f595-8855-40f3-9af0-d9aa4edb235f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:14:02.882537 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55dc75-f13c-4a57-a126-0db5a655b1a3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14eeba99731f4c0f98ea78914f8ed697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:14:02.883199 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55dc75-f13c-4a57-a126-0db5a655b1a3 service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:02.883462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55dc75-f13c-4a57-a126-0db5a655b1a3 service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:02.883699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55dc75-f13c-4a57-a126-0db5a655b1a3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:02.891857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55dc75-f13c-4a57-a126-0db5a655b1a3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:14:02.893418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55dc75-f13c-4a57-a126-0db5a655b1a3 service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:14:02.903085 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 755/1521] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:14:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:14:04.694847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181866d3-6d3b-484b-a83c-269b037f53f5 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:04.695763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181866d3-6d3b-484b-a83c-269b037f53f5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:04.695763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181866d3-6d3b-484b-a83c-269b037f53f5 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:04.697734 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 767/1522] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:14:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:14:04.705944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d46604-717a-4e46-af04-4a1f2c81718c None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:04.706700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d46604-717a-4e46-af04-4a1f2c81718c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:04.706908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d46604-717a-4e46-af04-4a1f2c81718c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:04.731425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-36d46604-717a-4e46-af04-4a1f2c81718c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:14:04.732619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-36d46604-717a-4e46-af04-4a1f2c81718c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:04.740966 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 756/1523] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:14:04.897986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181866d3-6d3b-484b-a83c-269b037f53f5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:14:04.915540 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-181866d3-6d3b-484b-a83c-269b037f53f5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:14:04.921106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac3ab21-7cc7-494b-bac1-ac7169825a25 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:14:04.921727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3ab21-7cc7-494b-bac1-ac7169825a25 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:04.922031 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3ab21-7cc7-494b-bac1-ac7169825a25 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:04.922338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac3ab21-7cc7-494b-bac1-ac7169825a25 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:04.931037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3ab21-7cc7-494b-bac1-ac7169825a25 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:14:04.932629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eac3ab21-7cc7-494b-bac1-ac7169825a25 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:14:04.942082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 768/1524] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:14:05.753986 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4351c-2464-4910-b209-1dabf5daab21 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:05.754987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4351c-2464-4910-b209-1dabf5daab21 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:05.754987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b4351c-2464-4910-b209-1dabf5daab21 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:05.756512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 757/1525] 127.0.0.1 () {54 vars in 901 bytes} [Mon Aug 8 01:14:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:14:05.761914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccf9d9-949f-4d57-9d39-ac067f1aa70a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:05.762672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccf9d9-949f-4d57-9d39-ac067f1aa70a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:05.762905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ccf9d9-949f-4d57-9d39-ac067f1aa70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:05.785159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-59ccf9d9-949f-4d57-9d39-ac067f1aa70a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:14:05.786423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-59ccf9d9-949f-4d57-9d39-ac067f1aa70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:05.794367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 769/1526] 127.0.0.1 () {58 vars in 998 bytes} [Mon Aug 8 01:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:14:05.953238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4351c-2464-4910-b209-1dabf5daab21 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:14:05.969480 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b4351c-2464-4910-b209-1dabf5daab21 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:14:05.975353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c114f29-de35-4cab-a399-c5cc4c895dd4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:14:05.976012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114f29-de35-4cab-a399-c5cc4c895dd4 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:05.976254 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114f29-de35-4cab-a399-c5cc4c895dd4 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:05.976538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c114f29-de35-4cab-a399-c5cc4c895dd4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:05.985237 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c114f29-de35-4cab-a399-c5cc4c895dd4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:14:05.986845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c114f29-de35-4cab-a399-c5cc4c895dd4 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:14:05.996871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 758/1527] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:14:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:14:09.922717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d5ce-184b-45a7-9dd3-8503e07d018a None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:09.923545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d5ce-184b-45a7-9dd3-8503e07d018a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:09.923545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d4d5ce-184b-45a7-9dd3-8503e07d018a None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:09.925678 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 770/1528] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:14:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:14:09.935500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc771-b954-495d-aff9-688a92c9b119 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:09.936250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc771-b954-495d-aff9-688a92c9b119 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:09.936413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bcc771-b954-495d-aff9-688a92c9b119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:09.958173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b2bcc771-b954-495d-aff9-688a92c9b119 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:14:09.959372 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b2bcc771-b954-495d-aff9-688a92c9b119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:09.968955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 759/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:14:10.044440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4d5ce-184b-45a7-9dd3-8503e07d018a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:14:10.046558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-49d4d5ce-184b-45a7-9dd3-8503e07d018a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:10.136213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d4d5ce-184b-45a7-9dd3-8503e07d018a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:14:10.140063 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5a29a8-a7c9-4116-9d1f-28f6f529f884 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:14:10.140698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a29a8-a7c9-4116-9d1f-28f6f529f884 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:10.140957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a29a8-a7c9-4116-9d1f-28f6f529f884 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:10.141226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5a29a8-a7c9-4116-9d1f-28f6f529f884 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:10.150514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a29a8-a7c9-4116-9d1f-28f6f529f884 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:14:10.151949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5a29a8-a7c9-4116-9d1f-28f6f529f884 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:14:10.161581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 771/1530] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:14:12.201722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632eac-8332-40be-adcf-d4209c18de6c None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:12.202526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632eac-8332-40be-adcf-d4209c18de6c None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:12.202526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7632eac-8332-40be-adcf-d4209c18de6c None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:12.203792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 760/1531] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:14:12.209660 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3786fb-98dc-4963-9663-87d583890be1 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:12.210239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3786fb-98dc-4963-9663-87d583890be1 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:12.210419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3786fb-98dc-4963-9663-87d583890be1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:12.239465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3c3786fb-98dc-4963-9663-87d583890be1 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:14:12.240686 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3c3786fb-98dc-4963-9663-87d583890be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:12.256819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 772/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:14:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:14:12.300261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632eac-8332-40be-adcf-d4209c18de6c None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:14:12.317043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7632eac-8332-40be-adcf-d4209c18de6c None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:14:12.322844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01c63ff-f39d-4501-aede-57fd2089e1f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:14:12.323785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c63ff-f39d-4501-aede-57fd2089e1f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:12.324275 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c63ff-f39d-4501-aede-57fd2089e1f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:12.324704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01c63ff-f39d-4501-aede-57fd2089e1f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:12.339967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c63ff-f39d-4501-aede-57fd2089e1f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:14:12.341724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01c63ff-f39d-4501-aede-57fd2089e1f4 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:14:12.353510 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 761/1533] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:14:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:14:15.953019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3af5f-f21b-41df-af38-e8bc05d1d80f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:15.953607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3af5f-f21b-41df-af38-e8bc05d1d80f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:15.953607 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b3af5f-f21b-41df-af38-e8bc05d1d80f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:15.954941 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 773/1534] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:14:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:14:15.961310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3ef3d-69cd-4ce4-8756-473fb67fec29 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:15.962001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3ef3d-69cd-4ce4-8756-473fb67fec29 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:15.962269 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e3ef3d-69cd-4ce4-8756-473fb67fec29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:15.985289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-06e3ef3d-69cd-4ce4-8756-473fb67fec29 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:14:15.986576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-06e3ef3d-69cd-4ce4-8756-473fb67fec29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:15.995844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 762/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:14:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:14:16.299697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3af5f-f21b-41df-af38-e8bc05d1d80f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:14:16.302248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-59b3af5f-f21b-41df-af38-e8bc05d1d80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:16.373100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:14:16.388267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b3af5f-f21b-41df-af38-e8bc05d1d80f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:14:16.392373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657b1be-c8ca-4dff-b81b-6be9fb6d89ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:14:16.392976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b1be-c8ca-4dff-b81b-6be9fb6d89ed service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:16.393252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b1be-c8ca-4dff-b81b-6be9fb6d89ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:16.393522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657b1be-c8ca-4dff-b81b-6be9fb6d89ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:16.403558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657b1be-c8ca-4dff-b81b-6be9fb6d89ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:14:16.405008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b657b1be-c8ca-4dff-b81b-6be9fb6d89ed service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:14:16.415633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 774/1536] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:14:18.465215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70375-058a-42b9-9c23-530797b1050e None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:18.465756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70375-058a-42b9-9c23-530797b1050e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:18.465756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e70375-058a-42b9-9c23-530797b1050e None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:18.467730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 763/1537] 127.0.0.1 () {54 vars in 917 bytes} [Mon Aug 8 01:14:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:14:18.475186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268290-3094-4cb8-bd55-e5eb920444cd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:18.475635 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268290-3094-4cb8-bd55-e5eb920444cd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:18.475747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7268290-3094-4cb8-bd55-e5eb920444cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:18.496447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c7268290-3094-4cb8-bd55-e5eb920444cd None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:14:18.497652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c7268290-3094-4cb8-bd55-e5eb920444cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:18.506450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 775/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Mon Aug 8 01:14:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:14:18.816033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e70375-058a-42b9-9c23-530797b1050e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:14:18.818704 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-97e70375-058a-42b9-9c23-530797b1050e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:14:18.831004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=84 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:14:18.838608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e70375-058a-42b9-9c23-530797b1050e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:14:18.843982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d6fc8d-469b-420b-9782-d1a5394d0bfb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:14:18.844574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6fc8d-469b-420b-9782-d1a5394d0bfb service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:14:18.844856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6fc8d-469b-420b-9782-d1a5394d0bfb service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:14:18.845127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d6fc8d-469b-420b-9782-d1a5394d0bfb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:14:18.854445 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6fc8d-469b-420b-9782-d1a5394d0bfb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:14:18.855853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d6fc8d-469b-420b-9782-d1a5394d0bfb service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:14:18.865814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 764/1539] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:14:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:14:28.491835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=11 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:14:28.861812 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:42.883664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682df8-e45a-4ab8-95c8-b76741cc0e4c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:42.884340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682df8-e45a-4ab8-95c8-b76741cc0e4c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:42.884340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b682df8-e45a-4ab8-95c8-b76741cc0e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:42.907258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-4b682df8-e45a-4ab8-95c8-b76741cc0e4c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:42.908662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4b682df8-e45a-4ab8-95c8-b76741cc0e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:42.910743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefe5ba-cc56-4396-ada8-3dd8365880e0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:42.911257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefe5ba-cc56-4396-ada8-3dd8365880e0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:42.911351 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdefe5ba-cc56-4396-ada8-3dd8365880e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:42.926752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 776/1540] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:42.938546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a189-98c1-4665-a723-a1d15155a766 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:42.938901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a189-98c1-4665-a723-a1d15155a766 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:42.939083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234a189-98c1-4665-a723-a1d15155a766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:42.939327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-bdefe5ba-cc56-4396-ada8-3dd8365880e0 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:42.946534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-bdefe5ba-cc56-4396-ada8-3dd8365880e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:42.956226 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 765/1541] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:15:42.957642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916191-e4c1-49ed-9b39-905cdbee912a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:42.957929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916191-e4c1-49ed-9b39-905cdbee912a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:42.958247 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a916191-e4c1-49ed-9b39-905cdbee912a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:42.977887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e234a189-98c1-4665-a723-a1d15155a766 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:42.979187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e234a189-98c1-4665-a723-a1d15155a766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:42.996405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 777/1542] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:42.997815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fed98-041f-4b65-8460-0068e66be7e4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:42.998100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fed98-041f-4b65-8460-0068e66be7e4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:42.998378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fed98-041f-4b65-8460-0068e66be7e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:42.999461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5a916191-e4c1-49ed-9b39-905cdbee912a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.000721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5a916191-e4c1-49ed-9b39-905cdbee912a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.010785 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 766/1543] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.011838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0340dc-8ee1-4f98-9a0c-bf3ecebc43b9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.012124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0340dc-8ee1-4f98-9a0c-bf3ecebc43b9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.012399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0340dc-8ee1-4f98-9a0c-bf3ecebc43b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.022963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-514fed98-041f-4b65-8460-0068e66be7e4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.024170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-514fed98-041f-4b65-8460-0068e66be7e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.033400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0d0340dc-8ee1-4f98-9a0c-bf3ecebc43b9 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.034230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 778/1544] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.034699 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0d0340dc-8ee1-4f98-9a0c-bf3ecebc43b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.035406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668dd48-a1d3-4941-b0df-5f3dcdd2cfde None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.036926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668dd48-a1d3-4941-b0df-5f3dcdd2cfde None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.037207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b668dd48-a1d3-4941-b0df-5f3dcdd2cfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.046173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 767/1545] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.047423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0340dc-8ee1-4f98-9a0c-bf3ecebc43b9 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.058581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0340dc-8ee1-4f98-9a0c-bf3ecebc43b9 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.061853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b668dd48-a1d3-4941-b0df-5f3dcdd2cfde None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.063088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b668dd48-a1d3-4941-b0df-5f3dcdd2cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.063289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.064035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.064319 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.064591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.065263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.065569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.066613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:15:43.066613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Aug 08 01:15:43.066613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: Aug 08 01:15:43.067555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7f8af6-db1f-4b9e-a3b3-22da16b2f7d9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.071248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 779/1546] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.072456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19eaa-59ba-44b9-9188-15a25e2cddac None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.072740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19eaa-59ba-44b9-9188-15a25e2cddac None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.073015 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c19eaa-59ba-44b9-9188-15a25e2cddac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.079911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 768/1547] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.081293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c826-e2b8-4a8e-af89-0dd151d4c608 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.081580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c826-e2b8-4a8e-af89-0dd151d4c608 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.081857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab27c826-e2b8-4a8e-af89-0dd151d4c608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.094686 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-26c19eaa-59ba-44b9-9188-15a25e2cddac None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.095886 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-26c19eaa-59ba-44b9-9188-15a25e2cddac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.101174 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ab27c826-e2b8-4a8e-af89-0dd151d4c608 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.102390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ab27c826-e2b8-4a8e-af89-0dd151d4c608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.103978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 780/1548] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.105169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973d3c-fa46-4ee2-8377-827db2842984 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.105455 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973d3c-fa46-4ee2-8377-827db2842984 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.105727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62973d3c-fa46-4ee2-8377-827db2842984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.115166 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 769/1549] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.119118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055d64-e357-4263-9f3c-9cdf55c84cec None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.119430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055d64-e357-4263-9f3c-9cdf55c84cec None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.119827 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1055d64-e357-4263-9f3c-9cdf55c84cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.126258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-62973d3c-fa46-4ee2-8377-827db2842984 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.127465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-62973d3c-fa46-4ee2-8377-827db2842984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.136020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 781/1550] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.137064 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62973d3c-fa46-4ee2-8377-827db2842984 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.140067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a1055d64-e357-4263-9f3c-9cdf55c84cec None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.141263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a1055d64-e357-4263-9f3c-9cdf55c84cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.149969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 770/1551] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.151089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38be9-e7c2-4046-ab93-8303c5a98ec2 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.151371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38be9-e7c2-4046-ab93-8303c5a98ec2 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.151641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b38be9-e7c2-4046-ab93-8303c5a98ec2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.152111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62973d3c-fa46-4ee2-8377-827db2842984 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.156856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068a889f-3fe3-4935-a696-7292660b9156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.157453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a889f-3fe3-4935-a696-7292660b9156 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.157732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a889f-3fe3-4935-a696-7292660b9156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.158002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068a889f-3fe3-4935-a696-7292660b9156 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.158684 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a889f-3fe3-4935-a696-7292660b9156 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.159025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a889f-3fe3-4935-a696-7292660b9156 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.160643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068a889f-3fe3-4935-a696-7292660b9156 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.170287 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d7b38be9-e7c2-4046-ab93-8303c5a98ec2 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.171516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d7b38be9-e7c2-4046-ab93-8303c5a98ec2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.179846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 782/1552] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.179846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3075c61-8f69-41fb-8c9e-9444e7b0b534 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.179846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3075c61-8f69-41fb-8c9e-9444e7b0b534 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.179846 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3075c61-8f69-41fb-8c9e-9444e7b0b534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.180603 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 771/1553] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.181435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38be9-e7c2-4046-ab93-8303c5a98ec2 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.191919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b38be9-e7c2-4046-ab93-8303c5a98ec2 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.194101 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-f3075c61-8f69-41fb-8c9e-9444e7b0b534 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.195330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f3075c61-8f69-41fb-8c9e-9444e7b0b534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.196736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7ba58-f782-4424-ac49-233afb013cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.197333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ba58-f782-4424-ac49-233afb013cf1 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.197604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ba58-f782-4424-ac49-233afb013cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.197872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7ba58-f782-4424-ac49-233afb013cf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.198507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7ba58-f782-4424-ac49-233afb013cf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.200412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e7ba58-f782-4424-ac49-233afb013cf1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.203367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 783/1554] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.204483 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0da11-ef31-4678-8e58-43da34611965 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.204761 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0da11-ef31-4678-8e58-43da34611965 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.205039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f0da11-ef31-4678-8e58-43da34611965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.224094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-25f0da11-ef31-4678-8e58-43da34611965 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.225277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-25f0da11-ef31-4678-8e58-43da34611965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.233482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 784/1555] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.234522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0da11-ef31-4678-8e58-43da34611965 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.244365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f0da11-ef31-4678-8e58-43da34611965 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.244550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 772/1556] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 365 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.245910 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe368a6-afef-4668-8557-9bfb79d70295 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.246185 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe368a6-afef-4668-8557-9bfb79d70295 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.246456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe368a6-afef-4668-8557-9bfb79d70295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.265821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-dfe368a6-afef-4668-8557-9bfb79d70295 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.267045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-dfe368a6-afef-4668-8557-9bfb79d70295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.303867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.304478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.304752 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.305485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.305682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.306412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.307624 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.327288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 785/1557] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.327288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.327895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 773/1558] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.327895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe368a6-afef-4668-8557-9bfb79d70295 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.335535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a500c04a-5589-404b-82fb-a34549ac8f41 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.336956 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe368a6-afef-4668-8557-9bfb79d70295 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.340208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0d79d7-fc2e-4028-8c22-a9885b9b257e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.340807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d79d7-fc2e-4028-8c22-a9885b9b257e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.341084 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d79d7-fc2e-4028-8c22-a9885b9b257e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.341352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0d79d7-fc2e-4028-8c22-a9885b9b257e admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.341467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.341987 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.342107 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d79d7-fc2e-4028-8c22-a9885b9b257e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.342294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.342405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d79d7-fc2e-4028-8c22-a9885b9b257e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.342589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.343198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.344030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0d79d7-fc2e-4028-8c22-a9885b9b257e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.345056 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.356397 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 786/1559] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.357617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f836f-329d-40f0-a9e4-7177c96ba7df None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.357898 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f836f-329d-40f0-a9e4-7177c96ba7df None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.358202 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa2f836f-329d-40f0-a9e4-7177c96ba7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.376272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 774/1560] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.377689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.383399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-aa2f836f-329d-40f0-a9e4-7177c96ba7df None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:43.384594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-aa2f836f-329d-40f0-a9e4-7177c96ba7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:43.440567 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:43.444380 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 787/1561] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:43.445481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f836f-329d-40f0-a9e4-7177c96ba7df None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.445654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34d21f2-6258-41a3-b729-47b818523731 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.451528 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.452139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.452416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.452691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.453359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.453630 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.455256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.457475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa2f836f-329d-40f0-a9e4-7177c96ba7df None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.462148 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.462766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.463042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.463313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.463956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.464256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.465842 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.467503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 775/1562] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.468365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.482496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0030eba-46c4-4e72-b431-4dee3d6b154e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.483625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 788/1563] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.484310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.489175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:43.491544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.492425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.492682 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.492955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.493619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.494422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6c543-0639-4fc9-8299-65b8525c80ae admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.494747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:15:43.494747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Aug 08 01:15:43.494747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: Aug 08 01:15:43.495958 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.499369 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.499957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.500232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.500501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.501116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.502162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:15:43.502162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:15:43.502162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:15:43.503747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.525393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 776/1564] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/users => generated 283 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.525393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.532879 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de8630-71da-4e5e-b2e2-2927f47f53b8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.536935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 789/1565] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.537652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.537794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.538280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.538559 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.538833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.539517 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.539791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.541364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.554083 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 777/1566] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.559087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.569052 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a026efa-dad1-4a5d-b37a-c32b136359f3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.601279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c00eb5-9c84-4434-ad72-58d7cfa4fb46 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.607069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.607260 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.607534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.607800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.608416 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.610423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.625249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.625865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.626219 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.626575 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.627344 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.629937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.638342 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 790/1567] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 393 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.642285 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.656771 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 778/1568] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.656771 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.664384 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c7f3a1b-df01-44f1-81cd-4217fead9498 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.708259 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b849a6a8-1118-4e70-8bac-3b2be3fc9f48 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.713382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.713994 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.714303 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.714575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.715223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:43.715527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.717142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.718886 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.719498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.719769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.720042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.720654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.722637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.728785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 791/1569] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:43.729655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.740452 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9da01-9428-4120-95af-f402391e6ecc admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.746426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.747179 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.747458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.747727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.748353 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.750437 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.752368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 779/1570] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 389 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.753118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.782003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 792/1571] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 365 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.783120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.790409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:43.819088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96bf9de-de70-4aa2-9d46-17bfff7bc7a3 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.824984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:43.848237 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99d625-c92e-46ce-a227-d7bb44c62391 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.853220 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.853973 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.854243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.854556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.855190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.857178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.876551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.877173 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.877579 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.877851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.878808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.882542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 793/1572] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.882542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.882865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.890008 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0745a1bf-cf3e-4973-bb37-47a7a6263236 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.895610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 780/1573] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:43.895610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.896204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.896951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.897294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.897556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.898503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.900875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.911792 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70208e06-09a2-49f1-a735-af2c2b59c4da admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:43.918367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:43.919087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:43.919437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:43.919757 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:43.920491 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:43.923393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:43.936644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 794/1574] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.936644 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.954032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 781/1575] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/users => generated 297 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:43.955021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:43.964837 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3963927a-40d3-45ef-9f90-55c2ee4a9377 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.002596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2103588-354f-4d8f-997c-51df19721e9c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.007321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.007929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.008205 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.008495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.009134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.010762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.020535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.020719 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 795/1576] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.021309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.022755 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.023044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.023319 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.024204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.026326 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.030566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e9772-cad1-45ed-9c22-78d7a5537cb4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.035542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.036134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.036410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.036745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.037361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.039301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.056483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 782/1577] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:43 2022] POST /identity/v3/projects => generated 375 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:44.057234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.063288 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 796/1578] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:44.064301 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.074990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841fbf0f-63a5-41ff-a5eb-b3b1cb9a1068 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.100685 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:44.118965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad4beec-d95c-4009-957c-0aeb15a62fcb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.124917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.125516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.125799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.126094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.126728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.128808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.134964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.135582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.135860 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.136133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.136850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.138530 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.150166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 797/1579] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.150919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.151046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 783/1580] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:44.151930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.162775 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b00e0c-0535-4113-ae99-9007f41c2fa9 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.165214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db0aac9-18df-40dc-b309-2ad265800812 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.167700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.168287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.168563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.168831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.169466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.169952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.170580 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.170861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.171079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.171193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.171740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.173637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.183185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 798/1581] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.184095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.194942 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b97e1a7-03a1-4e63-b893-3701c6ee1706 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.198295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 784/1582] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/users => generated 287 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:44.199204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.199708 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.200318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.200575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.200842 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.201494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.203106 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.206625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:44.210112 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5ad400-6ac8-42ce-a215-10b4a6fa4c93 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.215114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.215656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.218810 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 799/1583] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.218954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.218954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.218954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.218954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.220204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.230122 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2fd5cd-05ba-4e4e-82b5-df0930e4a815 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.230504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 785/1584] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.231384 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.235521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.236120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.236403 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.236673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.237352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.239295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.241507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92033ca6-ad63-4c05-8f34-d028da28d05c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.246088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.246714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.246993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.247261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.247901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.249472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.260861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 786/1585] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.261748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.264153 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 800/1586] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/users => generated 288 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:44.265128 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.272839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f4dcd6-c618-4088-a8bc-a3d95307c364 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.275235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece76ffe-7ebd-45e6-8539-908bfbb23b60 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.277857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.278561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.278836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.279105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.279748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.280468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.281053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.281342 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.281461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.281575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.282269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.283855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.291939 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 787/1587] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.294662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 801/1588] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.295416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.295615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.306282 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b4ba5a-e6bd-468d-81cf-4781b13c35d7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.306693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3ea62-f005-4963-a4e4-420931e97145 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.311055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.311415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.311647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.311907 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.312031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.312184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.312295 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.312569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] PATH_INFO: `/v3/projects/00de4c1f2cb34b48bf20646b861fba27/users/9b613cff5af34da895974920b386b0de/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.312822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.314482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.324767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 802/1589] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.325690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.334568 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00de4c1f2cb34b48bf20646b861fba27, user_id=9b613cff5af34da895974920b386b0de, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.337550 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc6fd23-8f25-44ab-8333-cc4a6ebdbe2f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.337859 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.343235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.343967 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.344253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.344575 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.345330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.347493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.354686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 788/1590] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/00de4c1f2cb34b48bf20646b861fba27/users/9b613cff5af34da895974920b386b0de/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:44.355521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.361412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 803/1591] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.361412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.374327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6dd14d-dbcb-4d10-aec9-316494d1f7ba admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.423444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52ce67c-7313-4172-94cd-e0ccc7a703c2 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.428618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.429314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.429688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.430020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] PATH_INFO: `/v3/projects/816175644c874454840846739b5a7ac9/users/3a3c2513ee1442d4b8bdb82865575128/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.430157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.430729 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.431036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.431307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.431951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.433570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.443786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 804/1592] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.444690 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.449126 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=816175644c874454840846739b5a7ac9, user_id=3a3c2513ee1442d4b8bdb82865575128, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.451876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.454262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a5babe-58e9-4b65-b756-ff837e8a23f4 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.459210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.459793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.460073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.460341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.460972 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.462600 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.466268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 789/1593] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/816175644c874454840846739b5a7ac9/users/3a3c2513ee1442d4b8bdb82865575128/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:44.470235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.476431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 805/1594] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.476431 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.484129 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9491e2-7730-44ab-a44d-7765c5869cee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.512683 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:44.531462 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b2e770-7ea1-4ba1-8fac-7634f644be33 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.536332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.536998 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.537324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.537585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] PATH_INFO: `/v3/projects/3a3466a449424e9c97515b227e8a87de/users/737208373b72429db627c2e6dbfcb3ca/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.543737 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.544337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.544610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.544875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.545924 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.547561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.552520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a3466a449424e9c97515b227e8a87de, user_id=737208373b72429db627c2e6dbfcb3ca, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.555215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.557993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 806/1595] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.558826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.568887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9fbaa2-26d5-4f53-b33c-ce059fcff6e3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.571290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 790/1596] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/3a3466a449424e9c97515b227e8a87de/users/737208373b72429db627c2e6dbfcb3ca/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:44.572207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.611679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:44.634149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7e2488-45c0-4792-b165-f8635459c8dd admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.639412 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.640093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.640784 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.640784 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] PATH_INFO: `/v3/projects/b0d8d24c35a94cda967f276dab9d92b8/users/507c712815704d01ad656ed3f425a3ff/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.652088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1021549e-4d63-4cad-9ba8-8d4179d4aa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.652695 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021549e-4d63-4cad-9ba8-8d4179d4aa01 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.652978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021549e-4d63-4cad-9ba8-8d4179d4aa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.653249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1021549e-4d63-4cad-9ba8-8d4179d4aa01 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.653896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021549e-4d63-4cad-9ba8-8d4179d4aa01 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.655544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1021549e-4d63-4cad-9ba8-8d4179d4aa01 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.657398 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0d8d24c35a94cda967f276dab9d92b8, user_id=507c712815704d01ad656ed3f425a3ff, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.660360 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.665759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 807/1597] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.667003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a570c-5072-4583-aa55-1a143adc85fa None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.667286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a570c-5072-4583-aa55-1a143adc85fa None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.667562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732a570c-5072-4583-aa55-1a143adc85fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.676423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 791/1598] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/b0d8d24c35a94cda967f276dab9d92b8/users/507c712815704d01ad656ed3f425a3ff/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:44.677314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.698634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-732a570c-5072-4583-aa55-1a143adc85fa None None] MFA Rules not processed for user `9b613cff5af34da895974920b386b0de`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:44.699848 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-732a570c-5072-4583-aa55-1a143adc85fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:44.739773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0251d5bf-963a-461f-b8dc-bef95862203e admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.744765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b61eba5-781b-4487-9277-55754f659b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.745371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61eba5-781b-4487-9277-55754f659b53 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.745644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61eba5-781b-4487-9277-55754f659b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.745911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b61eba5-781b-4487-9277-55754f659b53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.746596 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61eba5-781b-4487-9277-55754f659b53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.748178 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b61eba5-781b-4487-9277-55754f659b53 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.757831 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 792/1599] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:44.759038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916590f7-fbbd-4f3f-ade6-10038d6edb96 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.759317 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916590f7-fbbd-4f3f-ade6-10038d6edb96 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.759585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916590f7-fbbd-4f3f-ade6-10038d6edb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.768208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 808/1600] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:44.769800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a570c-5072-4583-aa55-1a143adc85fa None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.780576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732a570c-5072-4583-aa55-1a143adc85fa None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.780751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-916590f7-fbbd-4f3f-ade6-10038d6edb96 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:44.781819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-916590f7-fbbd-4f3f-ade6-10038d6edb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:44.786272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eb9594-d6e1-43ad-a343-7b089df9497b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.786932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9594-d6e1-43ad-a343-7b089df9497b admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.787210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9594-d6e1-43ad-a343-7b089df9497b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.787482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eb9594-d6e1-43ad-a343-7b089df9497b admin admin] PATH_INFO: `/v3/projects/4cf5446d52364500aa0c50830370b4fb/users/fb2e93a5cbda44208b6cc9be8043b216/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.789821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 793/1601] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:44.790402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916590f7-fbbd-4f3f-ade6-10038d6edb96 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.800177 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916590f7-fbbd-4f3f-ade6-10038d6edb96 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.805104 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.805911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.806215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.806493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] PATH_INFO: `/v3/projects/b95bf45544054544b32119e23c6054bb/users/ae1f183cef7c44c09066b9db72816a90/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.807338 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9594-d6e1-43ad-a343-7b089df9497b admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cf5446d52364500aa0c50830370b4fb, user_id=fb2e93a5cbda44208b6cc9be8043b216, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.808417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-08eb9594-d6e1-43ad-a343-7b089df9497b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:15:44.808417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:15:44.808417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:15:44.810387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eb9594-d6e1-43ad-a343-7b089df9497b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.821916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b95bf45544054544b32119e23c6054bb, user_id=ae1f183cef7c44c09066b9db72816a90, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.824478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 809/1602] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/4cf5446d52364500aa0c50830370b4fb/users/fb2e93a5cbda44208b6cc9be8043b216/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:44.824653 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.825979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bfaef-17a3-46a0-b4df-abe87e534e55 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.826291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bfaef-17a3-46a0-b4df-abe87e534e55 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.826560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328bfaef-17a3-46a0-b4df-abe87e534e55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.839671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 794/1603] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/b95bf45544054544b32119e23c6054bb/users/ae1f183cef7c44c09066b9db72816a90/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:44.840737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.854692 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:44.866831 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-328bfaef-17a3-46a0-b4df-abe87e534e55 None None] MFA Rules not processed for user `737208373b72429db627c2e6dbfcb3ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:44.868051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-328bfaef-17a3-46a0-b4df-abe87e534e55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:44.905665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a788f-d8e4-4e30-8be2-87c6c725a089 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:44.911473 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:44.912142 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.912727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.912727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] PATH_INFO: `/v3/projects/21d9e6a85ea946bbaba47f89579799f9/users/6c7a493e254d41fea146e20f40d31fdb/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.929451 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21d9e6a85ea946bbaba47f89579799f9, user_id=6c7a493e254d41fea146e20f40d31fdb, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:44.931898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:44.935134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 810/1604] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:44.936759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ea3b0-4ac1-4a49-af83-85cb3ba0ef52 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:44.937165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ea3b0-4ac1-4a49-af83-85cb3ba0ef52 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:44.937443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711ea3b0-4ac1-4a49-af83-85cb3ba0ef52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:44.948137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 795/1605] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/21d9e6a85ea946bbaba47f89579799f9/users/6c7a493e254d41fea146e20f40d31fdb/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:44.951698 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:44.957174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-711ea3b0-4ac1-4a49-af83-85cb3ba0ef52 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:44.958636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-711ea3b0-4ac1-4a49-af83-85cb3ba0ef52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:44.974395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:45.026748 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 811/1606] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:45.027387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ea3b0-4ac1-4a49-af83-85cb3ba0ef52 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.028061 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94e5e27-59cd-4af1-ab96-7a4d90d9f8d8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.032878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.033576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.033858 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.034242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] PATH_INFO: `/v3/projects/c2e5ac0077af4d1ca4ba22e57830ca79/users/839ebdd1fe79424f90b1f810809ef0f3/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.042792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711ea3b0-4ac1-4a49-af83-85cb3ba0ef52 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.047474 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e32a141-4617-4654-8abf-c03ab6dc986f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.048231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a141-4617-4654-8abf-c03ab6dc986f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.048508 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a141-4617-4654-8abf-c03ab6dc986f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.048779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e32a141-4617-4654-8abf-c03ab6dc986f admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.049824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a141-4617-4654-8abf-c03ab6dc986f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.051763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e32a141-4617-4654-8abf-c03ab6dc986f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.054923 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2e5ac0077af4d1ca4ba22e57830ca79, user_id=839ebdd1fe79424f90b1f810809ef0f3, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.058212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.072663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 796/1607] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:44 2022] PUT /identity/v3/projects/c2e5ac0077af4d1ca4ba22e57830ca79/users/839ebdd1fe79424f90b1f810809ef0f3/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:45.077185 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.078771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 812/1608] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/projects => generated 365 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:45.080013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ff2c-6931-4689-9d23-f966ad162f96 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.080295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ff2c-6931-4689-9d23-f966ad162f96 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.080568 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c6ff2c-6931-4689-9d23-f966ad162f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.099112 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e3c6ff2c-6931-4689-9d23-f966ad162f96 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:45.100320 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e3c6ff2c-6931-4689-9d23-f966ad162f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:45.139394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c2e421-baed-4e3a-951e-d08247bba204 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.163518 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 813/1609] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:45.168316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79413b-e2dd-4bc1-8f23-bd13c59e99f6 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.168602 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79413b-e2dd-4bc1-8f23-bd13c59e99f6 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.169267 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df79413b-e2dd-4bc1-8f23-bd13c59e99f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.171705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:45.191026 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ce989c-d306-4523-9779-ce952c8962c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.191724 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce989c-d306-4523-9779-ce952c8962c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.192076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce989c-d306-4523-9779-ce952c8962c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.192414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ce989c-d306-4523-9779-ce952c8962c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.198975 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-df79413b-e2dd-4bc1-8f23-bd13c59e99f6 None None] MFA Rules not processed for user `ae1f183cef7c44c09066b9db72816a90`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:45.200745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-df79413b-e2dd-4bc1-8f23-bd13c59e99f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:45.201719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce989c-d306-4523-9779-ce952c8962c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.203193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ce989c-d306-4523-9779-ce952c8962c7 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.212745 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 797/1610] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:45.213981 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb786-01e1-4f1c-b575-c39824d4037e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.214270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb786-01e1-4f1c-b575-c39824d4037e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.214547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfcb786-01e1-4f1c-b575-c39824d4037e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.245212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-8bfcb786-01e1-4f1c-b575-c39824d4037e None None] MFA Rules not processed for user `6c7a493e254d41fea146e20f40d31fdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:45.246502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-8bfcb786-01e1-4f1c-b575-c39824d4037e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:45.268511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 814/1611] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:45.269591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd0fc3-9948-4887-827f-6f216c156d0d None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.269876 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd0fc3-9948-4887-827f-6f216c156d0d None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.270176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fd0fc3-9948-4887-827f-6f216c156d0d None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.271641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 815/1612] 10.222.0.39 () {54 vars in 962 bytes} [Mon Aug 8 01:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:15:45.276957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd0fc3-9948-4887-827f-6f216c156d0d None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.289449 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fd0fc3-9948-4887-827f-6f216c156d0d None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.294194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb75787f-10b1-47a8-89ad-9e9d8e7a1ef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.295089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75787f-10b1-47a8-89ad-9e9d8e7a1ef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.295476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75787f-10b1-47a8-89ad-9e9d8e7a1ef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.295976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb75787f-10b1-47a8-89ad-9e9d8e7a1ef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.307769 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75787f-10b1-47a8-89ad-9e9d8e7a1ef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.309671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb75787f-10b1-47a8-89ad-9e9d8e7a1ef1 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.322662 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 816/1613] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:45.323949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153213-a8e4-46ec-bc61-3871cf6d6904 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.324235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153213-a8e4-46ec-bc61-3871cf6d6904 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.324505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79153213-a8e4-46ec-bc61-3871cf6d6904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.330856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 798/1614] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:45.331544 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcb786-01e1-4f1c-b575-c39824d4037e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.343385 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfcb786-01e1-4f1c-b575-c39824d4037e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.349342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1d5b71-a89b-4abe-9600-baa7f83ccb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.349977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d5b71-a89b-4abe-9600-baa7f83ccb8d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.350293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d5b71-a89b-4abe-9600-baa7f83ccb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.350563 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1d5b71-a89b-4abe-9600-baa7f83ccb8d admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.351422 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d5b71-a89b-4abe-9600-baa7f83ccb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.352646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-79153213-a8e4-46ec-bc61-3871cf6d6904 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:45.353318 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1d5b71-a89b-4abe-9600-baa7f83ccb8d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.354263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-79153213-a8e4-46ec-bc61-3871cf6d6904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:45.370086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 817/1615] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:45.370086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153213-a8e4-46ec-bc61-3871cf6d6904 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.380819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79153213-a8e4-46ec-bc61-3871cf6d6904 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.384208 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 799/1616] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/users => generated 289 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:45.387609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee5d3-fa76-4497-85a6-6fb909f2e1eb None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.388375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.389083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.389358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.389638 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee5d3-fa76-4497-85a6-6fb909f2e1eb None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.389911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ee5d3-fa76-4497-85a6-6fb909f2e1eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.390407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.401057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:45.403805 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.405825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.418145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 818/1617] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:45.419096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.443731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-2c2ee5d3-fa76-4497-85a6-6fb909f2e1eb None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:45.445251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2c2ee5d3-fa76-4497-85a6-6fb909f2e1eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:45.488359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ad8f05-f8a7-44a6-a197-805b4c44e5a6 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.492473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ae461-3284-43ff-ba4f-dc47fac6c11e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.493090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae461-3284-43ff-ba4f-dc47fac6c11e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.493365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae461-3284-43ff-ba4f-dc47fac6c11e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.494009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ae461-3284-43ff-ba4f-dc47fac6c11e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.504929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ae461-3284-43ff-ba4f-dc47fac6c11e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.506902 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6ae461-3284-43ff-ba4f-dc47fac6c11e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.517957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 819/1618] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:45.520293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802849-a408-47f4-ab3d-ad01da4eb1be None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.520580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802849-a408-47f4-ab3d-ad01da4eb1be None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.520901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69802849-a408-47f4-ab3d-ad01da4eb1be None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.522497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 820/1619] 10.222.0.39 () {54 vars in 962 bytes} [Mon Aug 8 01:15:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:15:45.523220 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802849-a408-47f4-ab3d-ad01da4eb1be None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.524859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-69802849-a408-47f4-ab3d-ad01da4eb1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:45.537762 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 800/1620] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:45.539129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ee5d3-fa76-4497-85a6-6fb909f2e1eb None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.544837 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69802849-a408-47f4-ab3d-ad01da4eb1be None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.551131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ab4c7-ad5a-4334-a78b-1c8ce6e74266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.551535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab4c7-ad5a-4334-a78b-1c8ce6e74266 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.551812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab4c7-ad5a-4334-a78b-1c8ce6e74266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.552225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ab4c7-ad5a-4334-a78b-1c8ce6e74266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.553247 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ee5d3-fa76-4497-85a6-6fb909f2e1eb None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.558619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.559405 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.559936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.560411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.561540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.563411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ab4c7-ad5a-4334-a78b-1c8ce6e74266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.563678 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.564850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ab4c7-ad5a-4334-a78b-1c8ce6e74266 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.576084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 801/1621] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:45.576595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 821/1622] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:45.578142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7bde-05a6-47cf-9559-3bf2f5703a6a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.578429 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7bde-05a6-47cf-9559-3bf2f5703a6a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.578709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1de7bde-05a6-47cf-9559-3bf2f5703a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.580351 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.595917 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60d392-346f-4652-b01f-925c01122512 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.602126 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.602717 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b1de7bde-05a6-47cf-9559-3bf2f5703a6a None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:45.602991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.603381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.603814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.604735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b1de7bde-05a6-47cf-9559-3bf2f5703a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:45.618874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 822/1623] 10.222.0.39 () {58 vars in 1059 bytes} [Mon Aug 8 01:15:45 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:45.620325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:45.621034 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7bde-05a6-47cf-9559-3bf2f5703a6a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.636317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1de7bde-05a6-47cf-9559-3bf2f5703a6a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.642928 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.644713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.645321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.646299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] PATH_INFO: `/v3/projects/c6d8ebef5dd54e7cae9fa076e729a997/users/1e1cce9e7e4449b7bd332f9871804ca4/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.670785 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d8ebef5dd54e7cae9fa076e729a997, user_id=1e1cce9e7e4449b7bd332f9871804ca4, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.676104 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.683249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.685456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.701495 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 823/1624] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:45 2022] PUT /identity/v3/projects/c6d8ebef5dd54e7cae9fa076e729a997/users/1e1cce9e7e4449b7bd332f9871804ca4/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:45.702681 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.715032 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 802/1625] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:45.717499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.742167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5660ed-0105-49c7-b93c-e1d8c50c79de service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.868897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.870767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.871270 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.872252 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.874443 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.879289 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:45.906696 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304282fd-771d-47b6-a42a-6409d9015237 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.912488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 803/1626] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:45.915081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:45.927199 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.929573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.930648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.931300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.949697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3138822a-572c-4c12-a5dd-a12cb22f9db0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:45.964234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4843fed8-e8c9-4346-997d-8e998c8fa5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:45.967130 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fed8-e8c9-4346-997d-8e998c8fa5ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:45.967519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fed8-e8c9-4346-997d-8e998c8fa5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:45.969082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4843fed8-e8c9-4346-997d-8e998c8fa5ae admin admin] PATH_INFO: `/v3/projects/c6d8ebef5dd54e7cae9fa076e729a997/users/1e1cce9e7e4449b7bd332f9871804ca4/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:45.973648 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843fed8-e8c9-4346-997d-8e998c8fa5ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6d8ebef5dd54e7cae9fa076e729a997, user_id=1e1cce9e7e4449b7bd332f9871804ca4, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:45.982747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4843fed8-e8c9-4346-997d-8e998c8fa5ae admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:46.034849 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 804/1627] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:45 2022] PUT /identity/v3/projects/c6d8ebef5dd54e7cae9fa076e729a997/users/1e1cce9e7e4449b7bd332f9871804ca4/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:46.038476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4a06-0151-491f-929b-747b39d83cb6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.039660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4a06-0151-491f-929b-747b39d83cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.039999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ede4a06-0151-491f-929b-747b39d83cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.092620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:46.127389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:46.132825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:46.133011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5ede4a06-0151-491f-929b-747b39d83cb6 None None] MFA Rules not processed for user `1e1cce9e7e4449b7bd332f9871804ca4`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:46.135425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5ede4a06-0151-491f-929b-747b39d83cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:46.165234 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 824/1628] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:46.260916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 805/1629] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:46.276728 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:46.367297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138cd2-2b29-4d02-982e-4810afaba3fe None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.367645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138cd2-2b29-4d02-982e-4810afaba3fe None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.368004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c138cd2-2b29-4d02-982e-4810afaba3fe None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.370293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 806/1630] 10.222.0.39 () {54 vars in 912 bytes} [Mon Aug 8 01:15:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:15:46.376613 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324458b3-8db6-477a-addb-79d09f9c8388 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.376872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324458b3-8db6-477a-addb-79d09f9c8388 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.377723 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324458b3-8db6-477a-addb-79d09f9c8388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.384865 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb3eae9-11a6-480b-8f03-b1517ba61144 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:46.427583 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-324458b3-8db6-477a-addb-79d09f9c8388 None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:46.429221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-324458b3-8db6-477a-addb-79d09f9c8388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:46.460821 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:46.461683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.461800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.462314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.475155 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:46.477197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:46.478880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:46.500197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 825/1631] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:46.642928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 807/1632] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Aug 8 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:46.680136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:46.693584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3f92b7-4d3d-40cd-8b70-205fc48bca6d service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:46.702855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2d1739-b11a-46df-a065-3adaeb5d9c0e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:46.703481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d1739-b11a-46df-a065-3adaeb5d9c0e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.703759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d1739-b11a-46df-a065-3adaeb5d9c0e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.704051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2d1739-b11a-46df-a065-3adaeb5d9c0e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.733781 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d1739-b11a-46df-a065-3adaeb5d9c0e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:46.735289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2d1739-b11a-46df-a065-3adaeb5d9c0e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:46.748068 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a4a4-9b50-424c-829f-e07fcbd04100 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.748356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a4a4-9b50-424c-829f-e07fcbd04100 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.748632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d71a4a4-9b50-424c-829f-e07fcbd04100 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.750179 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 808/1633] 10.222.0.39 () {54 vars in 912 bytes} [Mon Aug 8 01:15:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:15:46.751193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a4a4-9b50-424c-829f-e07fcbd04100 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:46.764387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 826/1634] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:46.766771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9727be-0232-46cc-ad53-8dc37400ea21 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.767089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9727be-0232-46cc-ad53-8dc37400ea21 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.767373 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9727be-0232-46cc-ad53-8dc37400ea21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.780165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d71a4a4-9b50-424c-829f-e07fcbd04100 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:46.788783 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:46.789702 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:46.790409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:46.790928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:46.810702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-3d9727be-0232-46cc-ad53-8dc37400ea21 None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:46.814016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3d9727be-0232-46cc-ad53-8dc37400ea21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:46.839547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 827/1635] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Aug 8 01:15:46 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:46.918359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:46.919912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:46.952971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 809/1636] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:15:47.241157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9727be-0232-46cc-ad53-8dc37400ea21 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:47.268330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9727be-0232-46cc-ad53-8dc37400ea21 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:47.290621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f5230-9920-43c6-ac78-16726837f3f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:47.291544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5230-9920-43c6-ac78-16726837f3f0 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:47.292527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5230-9920-43c6-ac78-16726837f3f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:47.293284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f5230-9920-43c6-ac78-16726837f3f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:47.331145 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f5230-9920-43c6-ac78-16726837f3f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:47.335322 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f5230-9920-43c6-ac78-16726837f3f0 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:47.366707 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 828/1637] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:47.632975 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:47.795808 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea4aff3-2207-44e0-aa02-f2ca648b715c service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:47.806276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:47.807137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:47.807806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:47.808153 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] PATH_INFO: `/v3/users/6c7a493e254d41fea146e20f40d31fdb` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:47.811710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c7a493e254d41fea146e20f40d31fdb)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:47.819506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:47.901005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c7a493e254d41fea146e20f40d31fdb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:47.916207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c7a493e254d41fea146e20f40d31fdb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:47.919395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:47.929137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c7a493e254d41fea146e20f40d31fdb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:47.949051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c7a493e254d41fea146e20f40d31fdb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:47.949824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c7a493e254d41fea146e20f40d31fdb'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:47.963870 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 810/1638] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:15:47 2022] DELETE /identity/v3/users/6c7a493e254d41fea146e20f40d31fdb => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:47.971446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:47.973015 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:47.973505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:48.001612 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:48.004194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:48.099514 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 829/1639] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:48.130314 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:48.132799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:48.253382 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bde2b7-cfb9-400b-9b28-2d6d0a343966 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:48.259268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0157677-40ba-453a-9c6a-475b527874ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:48.260242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157677-40ba-453a-9c6a-475b527874ee service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:48.260608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157677-40ba-453a-9c6a-475b527874ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:48.260887 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0157677-40ba-453a-9c6a-475b527874ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:48.273696 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157677-40ba-453a-9c6a-475b527874ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:48.275482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0157677-40ba-453a-9c6a-475b527874ee service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:48.292045 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 811/1640] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:49.769358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:49.771732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:49.799450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96403c29-e507-4afd-ae1f-5b35d1a2b681 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:49.841760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:49.841760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:49.841760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:49.841760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] PATH_INFO: `/v3/projects/21d9e6a85ea946bbaba47f89579799f9` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:49.847214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21d9e6a85ea946bbaba47f89579799f9)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:49.847214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:49.854834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:49.939974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21d9e6a85ea946bbaba47f89579799f9', 'request_id': 'req-75deb292-a1b9-42c2-a362-300f2c109ea5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:49.959098 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21d9e6a85ea946bbaba47f89579799f9', 'request_id': 'req-75deb292-a1b9-42c2-a362-300f2c109ea5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:49.980083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21d9e6a85ea946bbaba47f89579799f9', 'request_id': 'req-75deb292-a1b9-42c2-a362-300f2c109ea5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:50.003931 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] The token cache is being invalidate because project 21d9e6a85ea946bbaba47f89579799f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:15:50.004446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:50.005283 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-75deb292-a1b9-42c2-a362-300f2c109ea5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:15:50.014015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a458ef-8c30-4b5d-a011-e135271e0ce3 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.014801 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a458ef-8c30-4b5d-a011-e135271e0ce3 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.014801 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a458ef-8c30-4b5d-a011-e135271e0ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.018334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 830/1641] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:15:49 2022] DELETE /identity/v3/projects/21d9e6a85ea946bbaba47f89579799f9 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:15:50.068791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-93a458ef-8c30-4b5d-a011-e135271e0ce3 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:50.070324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-93a458ef-8c30-4b5d-a011-e135271e0ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:50.189088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 812/1642] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:50.197367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee226-d6e2-4301-83ad-ad171379e17a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.197655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee226-d6e2-4301-83ad-ad171379e17a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.197926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fee226-d6e2-4301-83ad-ad171379e17a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.222960 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e2fee226-d6e2-4301-83ad-ad171379e17a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:50.224965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e2fee226-d6e2-4301-83ad-ad171379e17a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:50.236133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 831/1643] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:50.241474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a458ef-8c30-4b5d-a011-e135271e0ce3 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:50.252523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a458ef-8c30-4b5d-a011-e135271e0ce3 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:50.257905 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:50.258467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.258749 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.259024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.259688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:15:50.259994 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:50.262475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:50.280455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 813/1644] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:15:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:15:50.282547 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fee226-d6e2-4301-83ad-ad171379e17a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:50.305110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2fee226-d6e2-4301-83ad-ad171379e17a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:50.312113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:50.312671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.312949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.313221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.313856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:50.316000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:50.364460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 832/1645] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:50 2022] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:50.369207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:50.381637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d2932d-7e1a-4105-b0d2-4024fa6e22f4 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:50.459143 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:50.460159 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.460752 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.461219 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.462237 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:50.465009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:50.478712 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:50.500553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 814/1646] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:50 2022] POST /identity/v3/users => generated 302 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:15:50.504461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:50.518709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810f461d-8d0e-4ed6-b398-fc539e7945d1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:50.524430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:50.525058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.525715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.525825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.526465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:50.529165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:50.541646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 833/1647] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:50.545444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:50.559167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fd29e9-dab0-4aba-9695-71e91cf5e25d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:50.567011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0f008-0efc-4c3b-910a-e4f522cc2a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:50.567728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0f008-0efc-4c3b-910a-e4f522cc2a7a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.568100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0f008-0efc-4c3b-910a-e4f522cc2a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.568667 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0f008-0efc-4c3b-910a-e4f522cc2a7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.569572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0f008-0efc-4c3b-910a-e4f522cc2a7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:50.572245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0d0f008-0efc-4c3b-910a-e4f522cc2a7a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:50.592169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 815/1648] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:15:50.593432 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:50.605347 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36cf6d9-5b25-416b-8423-37a4a0d04792 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:50.611699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:50.612817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.613311 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.613935 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] PATH_INFO: `/v3/projects/348b3c11ba304883ab4dd48ab5b16974/users/51c3641fc749469aa82f53793176eae8/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.634563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=348b3c11ba304883ab4dd48ab5b16974, user_id=51c3641fc749469aa82f53793176eae8, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:50.638223 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:50.667146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 834/1649] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:50 2022] PUT /identity/v3/projects/348b3c11ba304883ab4dd48ab5b16974/users/51c3641fc749469aa82f53793176eae8/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:50.668543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd0624-bbb0-40e7-95f1-c2e82ea31797 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:50.668990 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd0624-bbb0-40e7-95f1-c2e82ea31797 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:50.669390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cd0624-bbb0-40e7-95f1-c2e82ea31797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:50.721347 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b2cd0624-bbb0-40e7-95f1-c2e82ea31797 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:50.722604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b2cd0624-bbb0-40e7-95f1-c2e82ea31797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:50.852414 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 816/1650] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:50.897503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:50.900057 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:51.085310 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74cabc3-403f-4d6a-883e-53fab32b7b66 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:51.099299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:51.100167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:51.100596 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:51.101157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:51.141432 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:51.156689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:51.172856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 835/1651] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:55.009278 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5852c-88ed-44cf-9a9e-c03afa132209 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:55.009863 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5852c-88ed-44cf-9a9e-c03afa132209 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:55.009863 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5852c-88ed-44cf-9a9e-c03afa132209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:55.099357 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-39a5852c-88ed-44cf-9a9e-c03afa132209 None None] MFA Rules not processed for user `51c3641fc749469aa82f53793176eae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:55.100616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-39a5852c-88ed-44cf-9a9e-c03afa132209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:55.297299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 817/1652] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:55 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:55.298140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:55.311526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b33548-f980-498c-8fb3-dabfc7bab3a4 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:55.316632 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:55.317254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:55.317526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:55.317796 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:55.318503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:55.320444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:55.384411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 836/1653] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:15:55 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:15:55.388324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5852c-88ed-44cf-9a9e-c03afa132209 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:55.401950 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a5852c-88ed-44cf-9a9e-c03afa132209 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:55.515168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:55.515884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:55.516367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:55.516751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:55.517913 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:55.523750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:55.576649 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 818/1654] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:15:55 2022] POST /identity/v3/users => generated 309 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:15:55.579738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:55.593939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4274cca4-5551-4249-923b-c34a344e7079 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:55.605149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:55.608980 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:55.608980 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:55.609276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:55.610164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:55.613643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:55.646136 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:55.646889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 837/1655] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:55.653017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:55.698534 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bc2516-55a6-45e7-9f80-d2a73a40f813 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:55.708447 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:55.709329 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:55.709701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:55.710086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] PATH_INFO: `/v3/projects/da45973ee1ee4e96acfeedb6e0b07f35/users/bd065a17971b4da7b20f437f0ca6cfff/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:55.729859 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da45973ee1ee4e96acfeedb6e0b07f35, user_id=bd065a17971b4da7b20f437f0ca6cfff, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:55.733567 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:55.760387 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 819/1656] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:55 2022] PUT /identity/v3/projects/da45973ee1ee4e96acfeedb6e0b07f35/users/bd065a17971b4da7b20f437f0ca6cfff/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:15:55.764593 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:55.796506 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef4580-c255-4c8b-9e57-c8f23bd1fbf0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:55.812867 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:55.964645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb42b6b5-e6c3-482e-b08c-6354cae6c956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:55.966799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42b6b5-e6c3-482e-b08c-6354cae6c956 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:55.967875 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42b6b5-e6c3-482e-b08c-6354cae6c956 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:55.968819 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb42b6b5-e6c3-482e-b08c-6354cae6c956 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:55.970854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42b6b5-e6c3-482e-b08c-6354cae6c956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:55.974655 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb42b6b5-e6c3-482e-b08c-6354cae6c956 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:56.005324 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 838/1657] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:15:55 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:15:56.009249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:56.023789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5301de5a-8a5d-4935-a7b7-bebeb282e2a9 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:56.032687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4e9ae-76f7-4306-8ef5-a48811a926da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:56.033815 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4e9ae-76f7-4306-8ef5-a48811a926da admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:56.034530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4e9ae-76f7-4306-8ef5-a48811a926da admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:56.034884 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4e9ae-76f7-4306-8ef5-a48811a926da admin admin] PATH_INFO: `/v3/projects/da45973ee1ee4e96acfeedb6e0b07f35/users/bd065a17971b4da7b20f437f0ca6cfff/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:56.038030 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4e9ae-76f7-4306-8ef5-a48811a926da admin admin] RBAC: Authorizing `identity:create_grant(project_id=da45973ee1ee4e96acfeedb6e0b07f35, user_id=bd065a17971b4da7b20f437f0ca6cfff, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:56.044436 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4e9ae-76f7-4306-8ef5-a48811a926da admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:56.077475 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 820/1658] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:15:56 2022] PUT /identity/v3/projects/da45973ee1ee4e96acfeedb6e0b07f35/users/bd065a17971b4da7b20f437f0ca6cfff/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:15:56.982543 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:56.983073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:56.984348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:57.080759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] MFA Rules not processed for user `3a3c2513ee1442d4b8bdb82865575128`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:57.083248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:57.250337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 839/1659] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:57.252632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86976c1-2c87-4820-b09c-978c936dd72e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:57.253182 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86976c1-2c87-4820-b09c-978c936dd72e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:57.253661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86976c1-2c87-4820-b09c-978c936dd72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:57.279554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d86976c1-2c87-4820-b09c-978c936dd72e None None] MFA Rules not processed for user `3a3c2513ee1442d4b8bdb82865575128`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:57.280866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d86976c1-2c87-4820-b09c-978c936dd72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:57.294416 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 821/1660] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:57.301604 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:57.303961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:57.630528 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70177c4-512e-4105-bc04-780961dc1fab None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:57.648736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:57.650995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:57.651280 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:57.651678 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:57.690412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:57.692090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:57.766420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 840/1661] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:15:59.198336 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5b9d3-004e-487a-a308-ba44de88282f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:59.198829 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5b9d3-004e-487a-a308-ba44de88282f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:59.199067 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f5b9d3-004e-487a-a308-ba44de88282f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:59.267268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a1f5b9d3-004e-487a-a308-ba44de88282f None None] MFA Rules not processed for user `839ebdd1fe79424f90b1f810809ef0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:59.273411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a1f5b9d3-004e-487a-a308-ba44de88282f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:59.469895 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 822/1662] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:15:59.492584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:15:59.494228 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:59.529329 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdab868-7912-452d-b260-f979b2c35a8b service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:15:59.553602 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c0f380-9eb7-44bd-aeaa-68367dce5699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:15:59.554633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f380-9eb7-44bd-aeaa-68367dce5699 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:59.555143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f380-9eb7-44bd-aeaa-68367dce5699 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:59.555619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c0f380-9eb7-44bd-aeaa-68367dce5699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:59.580778 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0f380-9eb7-44bd-aeaa-68367dce5699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:15:59.582715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c0f380-9eb7-44bd-aeaa-68367dce5699 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:15:59.604505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 841/1663] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:15:59 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:15:59.788424 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e570bdf-7875-4aee-9968-b4ce61a213f9 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:59.789066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e570bdf-7875-4aee-9968-b4ce61a213f9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:59.789492 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e570bdf-7875-4aee-9968-b4ce61a213f9 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:59.791456 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 823/1664] 10.222.0.39 () {54 vars in 912 bytes} [Mon Aug 8 01:15:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:15:59.806226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:59.806830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:59.807270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:59.818951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:15:59.873885 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea7d8-7fa2-4139-abcd-e74ecc0c2bb9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:15:59.874430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea7d8-7fa2-4139-abcd-e74ecc0c2bb9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:15:59.874860 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5ea7d8-7fa2-4139-abcd-e74ecc0c2bb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:15:59.895850 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] MFA Rules not processed for user `4af463e787364ed680b453d027c81f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:59.897261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:15:59.916615 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-5f5ea7d8-7fa2-4139-abcd-e74ecc0c2bb9 None None] MFA Rules not processed for user `bd065a17971b4da7b20f437f0ca6cfff`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:15:59.918853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-5f5ea7d8-7fa2-4139-abcd-e74ecc0c2bb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:00.016797 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 842/1665] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Aug 8 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:00.075131 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:00.076588 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:00.100022 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06339b9e-a7ab-439a-875b-1cf3ae863ac5 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:00.101673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 824/1666] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:15:59 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:00.114981 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:00.115633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:00.115914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:00.116190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:00.139464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:00.140747 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:00.172837 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 843/1667] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:00.591880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a61d-74d9-47e2-b78d-9ca23bd40ab9 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:00.594871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a61d-74d9-47e2-b78d-9ca23bd40ab9 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:00.595845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1312a61d-74d9-47e2-b78d-9ca23bd40ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:00.665555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1312a61d-74d9-47e2-b78d-9ca23bd40ab9 None None] MFA Rules not processed for user `fb2e93a5cbda44208b6cc9be8043b216`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:00.668820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1312a61d-74d9-47e2-b78d-9ca23bd40ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:00.717574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:00.794375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 825/1668] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:00 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:00.904128 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:00.927408 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e135dcb-6f7a-462c-90a1-54580b3ada7e service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:00.938218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d714e5-81db-43db-95f4-6bbf9b5e8083 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:00.939711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d714e5-81db-43db-95f4-6bbf9b5e8083 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:00.940422 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d714e5-81db-43db-95f4-6bbf9b5e8083 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:00.942276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d714e5-81db-43db-95f4-6bbf9b5e8083 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:00.965480 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d714e5-81db-43db-95f4-6bbf9b5e8083 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:00.967485 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d714e5-81db-43db-95f4-6bbf9b5e8083 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:00.993760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 844/1669] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:00 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:01.566393 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739d67e-c521-4062-b5ca-6b50bf0762d7 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:01.566688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739d67e-c521-4062-b5ca-6b50bf0762d7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:01.566963 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3739d67e-c521-4062-b5ca-6b50bf0762d7 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:01.568457 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 826/1670] 10.222.0.39 () {54 vars in 961 bytes} [Mon Aug 8 01:16:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 08 01:16:01.574650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dc871-c1a0-479c-9341-e27505562a2c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:01.575167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dc871-c1a0-479c-9341-e27505562a2c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:01.575581 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24dc871-c1a0-479c-9341-e27505562a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:01.612685 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c24dc871-c1a0-479c-9341-e27505562a2c None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:01.616868 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c24dc871-c1a0-479c-9341-e27505562a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:01.731911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 845/1671] 10.222.0.39 () {58 vars in 1058 bytes} [Mon Aug 8 01:16:01 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:01.739577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739d67e-c521-4062-b5ca-6b50bf0762d7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:01.767663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3739d67e-c521-4062-b5ca-6b50bf0762d7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:01.773372 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975e3969-eb66-4e92-b332-4c7e629cf873 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14eeba99731f4c0f98ea78914f8ed697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:01.774172 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3969-eb66-4e92-b332-4c7e629cf873 service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:01.774538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3969-eb66-4e92-b332-4c7e629cf873 service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:01.775027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975e3969-eb66-4e92-b332-4c7e629cf873 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:01.778280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-975e3969-eb66-4e92-b332-4c7e629cf873 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:01.817507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e3969-eb66-4e92-b332-4c7e629cf873 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:01.819179 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975e3969-eb66-4e92-b332-4c7e629cf873 service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:01.846154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 827/1672] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:01 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:02.174460 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075ca1-0285-4de3-98e1-8cb0b263032b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:02.175183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075ca1-0285-4de3-98e1-8cb0b263032b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:02.175183 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d075ca1-0285-4de3-98e1-8cb0b263032b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:02.260166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0d075ca1-0285-4de3-98e1-8cb0b263032b None None] MFA Rules not processed for user `507c712815704d01ad656ed3f425a3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:02.261676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0d075ca1-0285-4de3-98e1-8cb0b263032b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:02.399501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:02.414481 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 846/1673] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:02.427387 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e64f6-d04e-4204-8f14-bd1a037ad408 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:02.427857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e64f6-d04e-4204-8f14-bd1a037ad408 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:02.428238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e64f6-d04e-4204-8f14-bd1a037ad408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:02.472283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ba9e64f6-d04e-4204-8f14-bd1a037ad408 None None] MFA Rules not processed for user `507c712815704d01ad656ed3f425a3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:02.477051 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ba9e64f6-d04e-4204-8f14-bd1a037ad408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:02.495590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 828/1674] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:02 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:02.507439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075ca1-0285-4de3-98e1-8cb0b263032b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:02.527822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d075ca1-0285-4de3-98e1-8cb0b263032b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:02.541053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d265b20e-5397-410c-95e4-cee9ffb9084c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:02.541756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265b20e-5397-410c-95e4-cee9ffb9084c service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:02.542130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265b20e-5397-410c-95e4-cee9ffb9084c service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:02.542471 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d265b20e-5397-410c-95e4-cee9ffb9084c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:02.567271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265b20e-5397-410c-95e4-cee9ffb9084c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:02.568912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d265b20e-5397-410c-95e4-cee9ffb9084c service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:02.593368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 847/1675] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:02 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:03.115532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eae6a-ccd2-4e88-a04c-6e7766931e61 None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:03.116077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eae6a-ccd2-4e88-a04c-6e7766931e61 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:03.116077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eae6a-ccd2-4e88-a04c-6e7766931e61 None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:03.129349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 829/1676] 10.222.0.39 () {54 vars in 921 bytes} [Mon Aug 8 01:16:03 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:16:03.149287 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:03.149576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:03.149858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:03.189811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] MFA Rules not processed for user `14eeba99731f4c0f98ea78914f8ed697`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:03.191768 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:03.218002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 848/1677] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Aug 8 01:16:03 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:03.243624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eae6a-ccd2-4e88-a04c-6e7766931e61 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:03.245607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-496eae6a-ccd2-4e88-a04c-6e7766931e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:03.278468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eae6a-ccd2-4e88-a04c-6e7766931e61 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:03.290847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b59e-fde4-46e8-afef-722a912a2fb5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14eeba99731f4c0f98ea78914f8ed697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:03.291974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b59e-fde4-46e8-afef-722a912a2fb5 service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:03.292427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b59e-fde4-46e8-afef-722a912a2fb5 service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:03.292847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b59e-fde4-46e8-afef-722a912a2fb5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:03.322554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b59e-fde4-46e8-afef-722a912a2fb5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:03.325501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b59e-fde4-46e8-afef-722a912a2fb5 service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:03.354479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 830/1678] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:04.017683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:04.017683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:04.217873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f9ba0-cc51-4b59-870f-9327ab0e91a0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:04.218467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f9ba0-cc51-4b59-870f-9327ab0e91a0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:04.218589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3f9ba0-cc51-4b59-870f-9327ab0e91a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:04.246216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78697e7-c85f-4bae-8686-059291170da3 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:04.266166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:04.267078 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:04.267191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-9d3f9ba0-cc51-4b59-870f-9327ab0e91a0 None None] MFA Rules not processed for user `507c712815704d01ad656ed3f425a3ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:04.267638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:04.268041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] PATH_INFO: `/v3/users/737208373b72429db627c2e6dbfcb3ca` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:04.273212 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] RBAC: Authorizing `identity:delete_user(user_id=737208373b72429db627c2e6dbfcb3ca)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:04.274565 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9d3f9ba0-cc51-4b59-870f-9327ab0e91a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:04.274743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: WARNING py.warnings [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:16:04.274743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: warnings.warn(msg) Aug 08 01:16:04.274743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: Aug 08 01:16:04.277566 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:04.305642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 831/1679] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:04.538580 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '737208373b72429db627c2e6dbfcb3ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:04.567637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '737208373b72429db627c2e6dbfcb3ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:04.607731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '737208373b72429db627c2e6dbfcb3ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:04.608804 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '737208373b72429db627c2e6dbfcb3ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:04.653780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '737208373b72429db627c2e6dbfcb3ca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:04.669340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 849/1680] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:04 2022] DELETE /identity/v3/users/737208373b72429db627c2e6dbfcb3ca => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:04.675304 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:04.675591 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:04.676048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:04.718665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:04.720203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:04.854619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 832/1681] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:05.050623 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:05.076476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:05.232217 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:05.234379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:05.253944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65969f81-d31e-4e4e-ae7e-45a61b982f24 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:05.263888 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:05.265570 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:05.266939 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:05.267817 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] PATH_INFO: `/v3/users/51c3641fc749469aa82f53793176eae8` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:05.271548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51c3641fc749469aa82f53793176eae8)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:05.276674 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:05.386692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9776f21b-da26-47a9-82fb-bd227693a30a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:05.407765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51c3641fc749469aa82f53793176eae8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:05.408693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e58cde8-df85-471f-bbf7-5480de952ddf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:05.409614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cde8-df85-471f-bbf7-5480de952ddf service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:05.411906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cde8-df85-471f-bbf7-5480de952ddf service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:05.413169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e58cde8-df85-471f-bbf7-5480de952ddf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:05.426371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51c3641fc749469aa82f53793176eae8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:05.438304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58cde8-df85-471f-bbf7-5480de952ddf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:05.440359 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e58cde8-df85-471f-bbf7-5480de952ddf service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:05.444485 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51c3641fc749469aa82f53793176eae8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:05.467773 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 850/1682] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:05.483850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:05.486027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51c3641fc749469aa82f53793176eae8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:05.488211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51c3641fc749469aa82f53793176eae8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:05.512031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 833/1683] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:05 2022] DELETE /identity/v3/users/51c3641fc749469aa82f53793176eae8 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:05.900916 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e931e3-8bc3-42d5-92db-0a7b5d103bec None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:05.901175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e931e3-8bc3-42d5-92db-0a7b5d103bec None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:05.901451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e931e3-8bc3-42d5-92db-0a7b5d103bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:05.919659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:05.988268 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:05.991365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:06.050634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-07e931e3-8bc3-42d5-92db-0a7b5d103bec None None] MFA Rules not processed for user `091efb05bd0b47fd87d3641bf7354284`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:06.055494 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-07e931e3-8bc3-42d5-92db-0a7b5d103bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:06.206786 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30993447-89fa-4ca0-926f-b332f3f2a3f4 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:06.237957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:06.240437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:06.240720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:06.240995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] PATH_INFO: `/v3/users/ae1f183cef7c44c09066b9db72816a90` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:06.249115 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1f183cef7c44c09066b9db72816a90)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:06.253894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:06.272451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 851/1684] 10.222.0.39 () {58 vars in 1009 bytes} [Mon Aug 8 01:16:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:06.374554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1f183cef7c44c09066b9db72816a90'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:06.393730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1f183cef7c44c09066b9db72816a90'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:06.403368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1f183cef7c44c09066b9db72816a90'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:06.439460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1f183cef7c44c09066b9db72816a90'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:06.442188 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1f183cef7c44c09066b9db72816a90'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:06.459323 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 834/1685] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:05 2022] DELETE /identity/v3/users/ae1f183cef7c44c09066b9db72816a90 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:06.464191 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b425-4bcb-442e-bdd9-8aefe9c65d16 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:06.464730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b425-4bcb-442e-bdd9-8aefe9c65d16 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:06.464730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9377b425-4bcb-442e-bdd9-8aefe9c65d16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:06.511874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9377b425-4bcb-442e-bdd9-8aefe9c65d16 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:06.513239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9377b425-4bcb-442e-bdd9-8aefe9c65d16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:06.636180 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:06.637775 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:06.700406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 852/1686] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:06.803051 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:06.803326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:06.803602 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:06.875357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] MFA Rules not processed for user `839ebdd1fe79424f90b1f810809ef0f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:06.877182 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:06.895929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:06.961076 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c4deb2-9aed-4f06-8747-658e33c55b55 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:06.985401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'd6ee2855740e4797afb4843d04446870', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:06.990207 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:06.995716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:06.995716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:07.002238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:07.140065 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:07.142572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:07.165346 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 835/1687] 10.222.0.39 () {60 vars in 1384 bytes} [Mon Aug 8 01:16:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 08 01:16:07.165873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 853/1688] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:07.166084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:07.168025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:07.170995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:07.185777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:07.226626 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec8fb2-1421-4003-9a28-d26e896dbceb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:07.248826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:07.249722 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:07.250354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:07.250934 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] PATH_INFO: `/v3/projects/348b3c11ba304883ab4dd48ab5b16974` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:07.254866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=348b3c11ba304883ab4dd48ab5b16974)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:07.258407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:07.320922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=100 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:07.518511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '348b3c11ba304883ab4dd48ab5b16974', 'request_id': 'req-d19abcf8-bb60-4dcd-849f-98ad78ab5652'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.540229 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '348b3c11ba304883ab4dd48ab5b16974', 'request_id': 'req-d19abcf8-bb60-4dcd-849f-98ad78ab5652'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.553049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '348b3c11ba304883ab4dd48ab5b16974', 'request_id': 'req-d19abcf8-bb60-4dcd-849f-98ad78ab5652'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.572316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] The token cache is being invalidate because project 348b3c11ba304883ab4dd48ab5b16974 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:07.573813 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.575537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.579459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 854/1689] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:07 2022] DELETE /identity/v3/projects/348b3c11ba304883ab4dd48ab5b16974 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:07.583775 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:07.586017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:07.604734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce50309-9f72-4dcf-9087-a0c9875e5adb service swift] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:07.750965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19abcf8-bb60-4dcd-849f-98ad78ab5652 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:07.767444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:07.769337 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:07.769619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:07.770646 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] PATH_INFO: `/v3/users/bd065a17971b4da7b20f437f0ca6cfff` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:07.774883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd065a17971b4da7b20f437f0ca6cfff)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:07.778947 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:07.811478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:07.812543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:07.814601 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:07.816931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:07.824376 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:07.877440 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:07.879079 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:07.916729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 836/1690] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 755 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:07.925071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd065a17971b4da7b20f437f0ca6cfff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.942626 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd065a17971b4da7b20f437f0ca6cfff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.964002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd065a17971b4da7b20f437f0ca6cfff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:07.966385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd065a17971b4da7b20f437f0ca6cfff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:08.010197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd065a17971b4da7b20f437f0ca6cfff'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:08.031588 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 855/1691] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:07 2022] DELETE /identity/v3/users/bd065a17971b4da7b20f437f0ca6cfff => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:08.856080 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:08.857655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:08.881377 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921fdbc3-d4ee-457f-b42c-966f6f9429f2 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:08.985379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:08.994467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:08.996267 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:08.996916 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:08.997574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] PATH_INFO: `/v3/users/9b613cff5af34da895974920b386b0de` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:09.015945 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:09.018289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:09.027402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] RBAC: Authorizing `identity:delete_user(user_id=9b613cff5af34da895974920b386b0de)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:09.038984 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:09.057300 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ecca8e3-dd9b-4684-a429-fb2cd3bb81f5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:09.068634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:09.071249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:09.071620 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:09.072404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] PATH_INFO: `/v3/projects/3a3466a449424e9c97515b227e8a87de` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:09.075462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a3466a449424e9c97515b227e8a87de)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:09.092605 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:09.180763 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:09.212548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9b613cff5af34da895974920b386b0de'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.235428 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9b613cff5af34da895974920b386b0de'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.260515 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a3466a449424e9c97515b227e8a87de', 'request_id': 'req-cf25afda-f4c8-459f-a9d4-fa7794e0270c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.269164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a3466a449424e9c97515b227e8a87de', 'request_id': 'req-cf25afda-f4c8-459f-a9d4-fa7794e0270c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.284800 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9b613cff5af34da895974920b386b0de'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.309054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a3466a449424e9c97515b227e8a87de', 'request_id': 'req-cf25afda-f4c8-459f-a9d4-fa7794e0270c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.358216 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9b613cff5af34da895974920b386b0de'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.360415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-bc0c9cce-326a-423d-bc2e-5c2fa32fafab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9b613cff5af34da895974920b386b0de'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.367172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] The token cache is being invalidate because project 3a3466a449424e9c97515b227e8a87de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:09.367469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.368985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:09.374702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 856/1692] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:09 2022] DELETE /identity/v3/projects/3a3466a449424e9c97515b227e8a87de => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:09.374702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:09.374702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:09.385836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 837/1693] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:08 2022] DELETE /identity/v3/users/9b613cff5af34da895974920b386b0de => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:09.387276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ccd1-47e8-417c-b3a7-bc891614087b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:09.387562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ccd1-47e8-417c-b3a7-bc891614087b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:09.387839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d295ccd1-47e8-417c-b3a7-bc891614087b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:09.526354 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d295ccd1-47e8-417c-b3a7-bc891614087b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:09.527612 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d295ccd1-47e8-417c-b3a7-bc891614087b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:09.665950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf25afda-f4c8-459f-a9d4-fa7794e0270c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:09.828495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 838/1694] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:09.829682 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb544b-d1e9-4aa5-a536-a1ca78d62007 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:09.834523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb544b-d1e9-4aa5-a536-a1ca78d62007 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:09.836339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fb544b-d1e9-4aa5-a536-a1ca78d62007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:09.857751 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:09.858689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:09.859155 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:09.859614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] PATH_INFO: `/v3/projects/da45973ee1ee4e96acfeedb6e0b07f35` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:09.864367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=da45973ee1ee4e96acfeedb6e0b07f35)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:09.866531 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:09.884607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d2fb544b-d1e9-4aa5-a536-a1ca78d62007 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:09.888014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d2fb544b-d1e9-4aa5-a536-a1ca78d62007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:09.915611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 839/1695] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:09.917429 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb756de-2a3b-4316-a57b-23d4ded3ed60 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:09.917883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb756de-2a3b-4316-a57b-23d4ded3ed60 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:09.918390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb756de-2a3b-4316-a57b-23d4ded3ed60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:09.945840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7cb756de-2a3b-4316-a57b-23d4ded3ed60 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:09.947972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7cb756de-2a3b-4316-a57b-23d4ded3ed60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:09.962896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 840/1696] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:09.965262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb756de-2a3b-4316-a57b-23d4ded3ed60 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:09.983034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb756de-2a3b-4316-a57b-23d4ded3ed60 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:10.000549 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:10.005158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:10.007754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:10.007754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:10.008924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:10.009283 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:10.018836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:10.046324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 841/1697] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:10.046324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:10.047158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:10.088628 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da45973ee1ee4e96acfeedb6e0b07f35', 'request_id': 'req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:10.101203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:10.109571 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da45973ee1ee4e96acfeedb6e0b07f35', 'request_id': 'req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:10.132718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da45973ee1ee4e96acfeedb6e0b07f35', 'request_id': 'req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:10.161601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] The token cache is being invalidate because project da45973ee1ee4e96acfeedb6e0b07f35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:10.162518 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:10.164321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:10.170177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 857/1698] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:09 2022] DELETE /identity/v3/projects/da45973ee1ee4e96acfeedb6e0b07f35 => generated 0 bytes in 798 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:10.172076 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:10.180030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:10.255091 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:10.268418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85282b44-0da8-4aa1-91e2-517ab2faf94d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:10.383130 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47f30ec-a1aa-4d4f-86d9-50bc01be20ab admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:10.401925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346e7241-f713-4df8-8785-7b5becc5e6ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:10.402735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7241-f713-4df8-8785-7b5becc5e6ee admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:10.403128 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7241-f713-4df8-8785-7b5becc5e6ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:10.403499 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e7241-f713-4df8-8785-7b5becc5e6ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:10.404241 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7241-f713-4df8-8785-7b5becc5e6ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:10.410689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346e7241-f713-4df8-8785-7b5becc5e6ee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:10.453856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:10.457812 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:10.458536 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:10.461818 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:10.468788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:10.492313 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 858/1699] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:10 2022] POST /identity/v3/projects => generated 373 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:10.493959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438914b-c042-4231-97f0-5c621b8a35f4 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:10.494446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438914b-c042-4231-97f0-5c621b8a35f4 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:10.494855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0438914b-c042-4231-97f0-5c621b8a35f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:10.544411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0438914b-c042-4231-97f0-5c621b8a35f4 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:10.547151 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:10.551772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:10.552462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0438914b-c042-4231-97f0-5c621b8a35f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:10.605922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 842/1700] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:10.617171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:10.651310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d86c9a-5b33-4030-9526-7a0659e41f59 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:10.802320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc12f5b-eecb-4b2d-a3a2-765f62dc58d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:10.803259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12f5b-eecb-4b2d-a3a2-765f62dc58d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:10.803802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12f5b-eecb-4b2d-a3a2-765f62dc58d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:10.804413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc12f5b-eecb-4b2d-a3a2-765f62dc58d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:10.805201 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc12f5b-eecb-4b2d-a3a2-765f62dc58d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:10.807813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc12f5b-eecb-4b2d-a3a2-765f62dc58d0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:10.851836 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 859/1701] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 359 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:10.855631 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 843/1702] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:10 2022] POST /identity/v3/users => generated 287 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:10.860077 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438914b-c042-4231-97f0-5c621b8a35f4 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:10.860543 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b7b4-d3e7-4663-9ced-0546a4d731ac None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:10.861235 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b7b4-d3e7-4663-9ced-0546a4d731ac None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:10.862134 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56b7b4-d3e7-4663-9ced-0546a4d731ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:10.894269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0438914b-c042-4231-97f0-5c621b8a35f4 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:10.920777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-1a56b7b4-d3e7-4663-9ced-0546a4d731ac None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:10.921218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:10.922627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:10.923065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:10.926908 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1a56b7b4-d3e7-4663-9ced-0546a4d731ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:10.930594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:10.932031 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:10.938443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:10.951263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 844/1703] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:10.954400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b7b4-d3e7-4663-9ced-0546a4d731ac None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:10.989259 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56b7b4-d3e7-4663-9ced-0546a4d731ac None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:10.993657 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 860/1704] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:10.998210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:11.003280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.006455 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.008499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.009102 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.010148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:11.011856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.016670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:11.064168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 845/1705] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:11.066155 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:11.077590 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80e09f5-eb82-4694-b1d0-7588a7a444ec admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:11.090691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.092091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.094025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.094984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.096709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.100030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:11.104662 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edebcfd-9c5a-4fdc-b905-e216512ca52b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:11.123152 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.124179 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.124610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.125078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.126245 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.133211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:11.136316 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 861/1706] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:11.137418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:11.166985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859e50fb-73ac-4bf9-9d48-bcf19ebaa70d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:11.184713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322ef68-efbe-4407-b82e-3d8d6e840fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.188232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ef68-efbe-4407-b82e-3d8d6e840fa1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.188549 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ef68-efbe-4407-b82e-3d8d6e840fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.189461 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ef68-efbe-4407-b82e-3d8d6e840fa1 admin admin] PATH_INFO: `/v3/projects/f6f6c6e4bac343729c4b95a91da26332/users/fa2a27a03f0f4bb09d69bcc3ed60fe0c/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.216296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 846/1707] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:11 2022] POST /identity/v3/projects => generated 381 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:11.220867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:11.250435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322ef68-efbe-4407-b82e-3d8d6e840fa1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6f6c6e4bac343729c4b95a91da26332, user_id=fa2a27a03f0f4bb09d69bcc3ed60fe0c, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.268371 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322ef68-efbe-4407-b82e-3d8d6e840fa1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:11.310413 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 862/1708] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:11 2022] PUT /identity/v3/projects/f6f6c6e4bac343729c4b95a91da26332/users/fa2a27a03f0f4bb09d69bcc3ed60fe0c/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:11.322399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b296589-b4b5-4b6d-83d0-ee4d87dc0b4e None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.322768 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b296589-b4b5-4b6d-83d0-ee4d87dc0b4e None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.323010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b296589-b4b5-4b6d-83d0-ee4d87dc0b4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.406279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:11.418562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-8b296589-b4b5-4b6d-83d0-ee4d87dc0b4e None None] MFA Rules not processed for user `fa2a27a03f0f4bb09d69bcc3ed60fe0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:11.422394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be21f09e-3371-4f14-8e5d-b4d7038fee1f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:11.428605 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8b296589-b4b5-4b6d-83d0-ee4d87dc0b4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:11.474583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:11.615954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.617506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.620053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.620955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.639504 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.641515 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 863/1709] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:11.642764 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:11.688311 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 847/1710] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:11 2022] POST /identity/v3/users => generated 291 bytes in 468 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:11.691611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b296589-b4b5-4b6d-83d0-ee4d87dc0b4e None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:11.711116 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b296589-b4b5-4b6d-83d0-ee4d87dc0b4e None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:11.725002 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.725670 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.726015 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.726321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.726990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.729279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:11.756123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 864/1711] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:11.760373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:11.776735 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5775bc57-7408-48ca-b2a5-bc59d4382f98 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:11.791401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa009e0-b40a-466c-a7c0-3abfa90be57f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.792019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa009e0-b40a-466c-a7c0-3abfa90be57f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.792312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa009e0-b40a-466c-a7c0-3abfa90be57f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.792569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa009e0-b40a-466c-a7c0-3abfa90be57f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.793250 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa009e0-b40a-466c-a7c0-3abfa90be57f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.800722 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa009e0-b40a-466c-a7c0-3abfa90be57f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:11.839659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 848/1712] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:11.843784 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:11.860812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4838d24-e1bc-4cb5-acd5-d9a1389c6242 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:11.892252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9ac1ce-4be7-44e8-b75d-133ada943da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:11.895892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac1ce-4be7-44e8-b75d-133ada943da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:11.898814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac1ce-4be7-44e8-b75d-133ada943da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:11.899858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9ac1ce-4be7-44e8-b75d-133ada943da1 admin admin] PATH_INFO: `/v3/projects/9007910fd1534294ae41dd08381aab4f/users/fd24131ffa194365b7a6b27844c6289a/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:11.966323 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ac1ce-4be7-44e8-b75d-133ada943da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9007910fd1534294ae41dd08381aab4f, user_id=fd24131ffa194365b7a6b27844c6289a, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:11.972973 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9ac1ce-4be7-44e8-b75d-133ada943da1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:12.029638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 865/1713] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:11 2022] PUT /identity/v3/projects/9007910fd1534294ae41dd08381aab4f/users/fd24131ffa194365b7a6b27844c6289a/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:12.051868 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:12.052897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:12.053324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:12.159256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] MFA Rules not processed for user `fd24131ffa194365b7a6b27844c6289a`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:12.162988 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:12.191702 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6f9a-0227-41b4-b0bc-e519358259fa None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:12.192286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6f9a-0227-41b4-b0bc-e519358259fa None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:12.192286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b6f9a-0227-41b4-b0bc-e519358259fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:12.231530 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0b1b6f9a-0227-41b4-b0bc-e519358259fa None None] MFA Rules not processed for user `fb2e93a5cbda44208b6cc9be8043b216`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:12.236572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0b1b6f9a-0227-41b4-b0bc-e519358259fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:12.421664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 866/1714] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:12.421664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5c6f-8243-4a88-bd62-d5f30daf19dc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:12.421664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5c6f-8243-4a88-bd62-d5f30daf19dc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:12.421664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ae5c6f-8243-4a88-bd62-d5f30daf19dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:12.423665 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 849/1715] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:12 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 374 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:12.424482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:12.430589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:12.477029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a0ae5c6f-8243-4a88-bd62-d5f30daf19dc None None] MFA Rules not processed for user `4af463e787364ed680b453d027c81f72`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:12.482304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a0ae5c6f-8243-4a88-bd62-d5f30daf19dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:12.642798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36486a-780e-4b09-b9c9-1a84ea6539c1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:12.662942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:12.664846 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:12.665129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:12.666668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:12.675910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 867/1716] 10.222.0.43 () {58 vars in 1015 bytes} [Mon Aug 8 01:16:12 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:12.678273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae5c6f-8243-4a88-bd62-d5f30daf19dc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:12.700401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:12.889060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:12.889980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:12.893186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:12.929296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 850/1717] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:12.975700 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:12.984560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:13.080758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ae5c6f-8243-4a88-bd62-d5f30daf19dc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:13.099037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:13.100273 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:13.100959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:13.101502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:13.112311 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:13.133479 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:13.222917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 868/1718] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:12 2022] POST /identity/v3/projects => generated 379 bytes in 546 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:13.224341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:13.231845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:13.277826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e537e7-5bad-4d38-be00-bfb3bf1a43b2 service nova] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:13.411966 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f380d38-cbd7-4bf3-b090-edb4a03a92a6 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:13.425334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:13.426667 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:13.428456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:13.429079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:13.445107 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:13.447011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:13.447442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:13.449251 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] PATH_INFO: `/v3/projects/b95bf45544054544b32119e23c6054bb` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:13.454273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] RBAC: Authorizing `identity:delete_project(project_id=b95bf45544054544b32119e23c6054bb)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:13.455688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: WARNING py.warnings [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 08 01:16:13.455688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: warnings.warn(msg) Aug 08 01:16:13.455688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: Aug 08 01:16:13.456953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:13.458611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:13.460178 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:13.485159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 869/1719] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:13.488459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:13.521573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ea3ec3-b401-4aa1-967e-dbef49c2cc26 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:13.541976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:13.541976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:13.541976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:13.541976 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:13.560552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:13.576470 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:13.622293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 870/1720] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:13 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:13.623757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:13.635170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:13.661778 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b95bf45544054544b32119e23c6054bb', 'request_id': 'req-07d1b312-4a1e-470a-b9c5-43db1ae13dab'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:13.674650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df89e75a-7521-40fa-b4b8-2b2865acc1e6 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:13.685991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:13.690402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b95bf45544054544b32119e23c6054bb', 'request_id': 'req-07d1b312-4a1e-470a-b9c5-43db1ae13dab'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:13.718989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b95bf45544054544b32119e23c6054bb', 'request_id': 'req-07d1b312-4a1e-470a-b9c5-43db1ae13dab'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:13.795355 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] The token cache is being invalidate because project b95bf45544054544b32119e23c6054bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:13.796873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:13.798558 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:13.828524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 851/1721] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:12 2022] DELETE /identity/v3/projects/b95bf45544054544b32119e23c6054bb => generated 0 bytes in 857 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:13.832460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:13.838387 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:13.881757 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:13.882532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:13.882859 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:13.883174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] PATH_INFO: `/v3/projects/00de4c1f2cb34b48bf20646b861fba27` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:13.891070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00de4c1f2cb34b48bf20646b861fba27)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:13.893592 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:14.064456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:14.067847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1b312-4a1e-470a-b9c5-43db1ae13dab admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:14.078796 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00de4c1f2cb34b48bf20646b861fba27', 'request_id': 'req-fe8948c7-a659-4bf5-83c3-83609c4f2d75'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.116421 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00de4c1f2cb34b48bf20646b861fba27', 'request_id': 'req-fe8948c7-a659-4bf5-83c3-83609c4f2d75'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.142196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00de4c1f2cb34b48bf20646b861fba27', 'request_id': 'req-fe8948c7-a659-4bf5-83c3-83609c4f2d75'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.175680 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] The token cache is being invalidate because project 00de4c1f2cb34b48bf20646b861fba27 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:14.176755 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.179557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-fe8948c7-a659-4bf5-83c3-83609c4f2d75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.182683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 871/1722] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:13 2022] DELETE /identity/v3/projects/00de4c1f2cb34b48bf20646b861fba27 => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:14.184023 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.184343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.184572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.226664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:14.227379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.227660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.227933 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.228577 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:14.230573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:14.250262 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:14.252639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:14.267496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 852/1723] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:13 2022] POST /identity/v3/users => generated 296 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:14.268359 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:14.275705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:14.283950 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 872/1724] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:14.285237 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:14.292383 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:14.307171 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34510fa7-61a6-4f99-9de3-a3f7e01007ca admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:14.313521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:14.314518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.314821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.315080 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] PATH_INFO: `/v3/users/1e1cce9e7e4449b7bd332f9871804ca4` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.316351 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88ab7a-c1e4-4789-8037-5a9d1943e9a7 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:14.316495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1e1cce9e7e4449b7bd332f9871804ca4)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:14.318717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:14.328041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686269f6-2b07-482b-87dc-aefaefcfc30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:14.329088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686269f6-2b07-482b-87dc-aefaefcfc30c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.330936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686269f6-2b07-482b-87dc-aefaefcfc30c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.332214 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686269f6-2b07-482b-87dc-aefaefcfc30c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.335650 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686269f6-2b07-482b-87dc-aefaefcfc30c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:14.339889 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686269f6-2b07-482b-87dc-aefaefcfc30c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:14.387298 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 873/1725] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:14.389079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77080ae7-eec0-4129-9cc4-d7c7fabbb22b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.391163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77080ae7-eec0-4129-9cc4-d7c7fabbb22b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.391853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77080ae7-eec0-4129-9cc4-d7c7fabbb22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.452824 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-77080ae7-eec0-4129-9cc4-d7c7fabbb22b None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:14.457037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-77080ae7-eec0-4129-9cc4-d7c7fabbb22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:14.486520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 874/1726] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:14.486520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77080ae7-eec0-4129-9cc4-d7c7fabbb22b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:14.502487 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77080ae7-eec0-4129-9cc4-d7c7fabbb22b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:14.505186 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1e1cce9e7e4449b7bd332f9871804ca4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.517100 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:14.518295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.518698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.519920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] PATH_INFO: `/v3/projects/bdabc959848f46caa32ef14559099997/users/bd8ae5ea6ac64505b309068b04f539d5/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.520332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1e1cce9e7e4449b7bd332f9871804ca4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.556448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1e1cce9e7e4449b7bd332f9871804ca4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.561980 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdabc959848f46caa32ef14559099997, user_id=bd8ae5ea6ac64505b309068b04f539d5, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:14.565314 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:14.612217 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 875/1727] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:14 2022] PUT /identity/v3/projects/bdabc959848f46caa32ef14559099997/users/bd8ae5ea6ac64505b309068b04f539d5/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:14.612217 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:14.614169 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=85,keystone:INSERT=5,keystone:DELETE=10 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:14.634822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1e1cce9e7e4449b7bd332f9871804ca4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.635585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1e1cce9e7e4449b7bd332f9871804ca4'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:14.648435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 853/1728] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:14 2022] DELETE /identity/v3/users/1e1cce9e7e4449b7bd332f9871804ca4 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:14.651922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:14.661538 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:14.778767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0ecc3d-d0ad-441c-acba-92bf81be4ce5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:14.855383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5cf42ff-b276-4736-b42c-dcca4386564c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:14.890540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:14.891290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.891474 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.891770 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.892553 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:14.894316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:14.934857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 854/1729] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:14.935815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:14.939005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.939400 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.939769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:14.941444 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.942835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:14.943760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:14.947853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:14.967830 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852beca6-a999-453c-b3e8-e3898783e950 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:14.975606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 876/1730] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 372 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:14.979478 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:14.983477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:14.989062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130f4619-81f0-4f9e-be86-d47340e1f739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:14.989941 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4619-81f0-4f9e-be86-d47340e1f739 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:14.990389 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4619-81f0-4f9e-be86-d47340e1f739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:14.990837 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130f4619-81f0-4f9e-be86-d47340e1f739 admin admin] PATH_INFO: `/v3/projects/bdabc959848f46caa32ef14559099997/users/bd8ae5ea6ac64505b309068b04f539d5/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:14.998511 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f4619-81f0-4f9e-be86-d47340e1f739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdabc959848f46caa32ef14559099997, user_id=bd8ae5ea6ac64505b309068b04f539d5, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:15.002264 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130f4619-81f0-4f9e-be86-d47340e1f739 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:15.013510 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fd215f-f18b-47a4-b447-d9af0a82a1fb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:15.024872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:15.025554 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.025835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.027139 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.027804 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:15.034558 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:15.061432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 855/1731] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:14 2022] PUT /identity/v3/projects/bdabc959848f46caa32ef14559099997/users/bd8ae5ea6ac64505b309068b04f539d5/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:15.071763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.072057 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.072302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.108682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 877/1732] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:14 2022] POST /identity/v3/projects => generated 381 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:15.116698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:15.140010 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:15.173995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] MFA Rules not processed for user `bd8ae5ea6ac64505b309068b04f539d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:15.175496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:15.323583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a45af-cf52-4a31-88c0-90fb9842db3c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:15.339081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:15.339699 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.339978 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.340265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.340884 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:15.343041 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:15.357847 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 856/1733] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:15.373581 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:15.377778 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:15.389357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 878/1734] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:15 2022] POST /identity/v3/users => generated 291 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:15.390294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:15.415774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902d5bca-6327-484e-a8bf-2d38904604ff admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:15.431492 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:15.432125 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.432892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.433258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.433827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:15.435767 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:15.470261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 879/1735] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:15.475256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:15.481673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7112fb-3f12-4b7b-b6be-e1bdca0a4669 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:15.515729 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:15.515971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79511d9-9ba2-4e18-a2f4-c252c9e7208c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:15.517168 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.517856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.518172 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.535893 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ca90e5-2eea-4bee-83c8-5bddc693e781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:15.537404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca90e5-2eea-4bee-83c8-5bddc693e781 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.538224 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca90e5-2eea-4bee-83c8-5bddc693e781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.538689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ca90e5-2eea-4bee-83c8-5bddc693e781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.539834 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca90e5-2eea-4bee-83c8-5bddc693e781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:15.549368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:15.552697 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:15.553563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ca90e5-2eea-4bee-83c8-5bddc693e781 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:15.596746 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 857/1736] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:15 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:15.603026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 880/1737] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:15.603210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:15.616501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:15.663836 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8645c28-f20f-49a6-8ca6-4a1bf950c3c3 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:15.682616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:15.684966 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.685877 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.686684 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] PATH_INFO: `/v3/projects/94eccd5eca6b46a4b44fa7dd95e1ba66/users/c5caed553b754775adeec3292e9e30af/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.822306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] RBAC: Authorizing `identity:create_grant(project_id=94eccd5eca6b46a4b44fa7dd95e1ba66, user_id=c5caed553b754775adeec3292e9e30af, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:15.828954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:15.911905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077dd42-d043-4796-a322-7af6007eb00b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:15.911905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077dd42-d043-4796-a322-7af6007eb00b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:15.911905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c077dd42-d043-4796-a322-7af6007eb00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:15.916725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 858/1738] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:15 2022] PUT /identity/v3/projects/94eccd5eca6b46a4b44fa7dd95e1ba66/users/c5caed553b754775adeec3292e9e30af/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:15.995239 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c077dd42-d043-4796-a322-7af6007eb00b None None] MFA Rules not processed for user `c5caed553b754775adeec3292e9e30af`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:15.995789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c077dd42-d043-4796-a322-7af6007eb00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:16.306356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 881/1739] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 396 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:16.313611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:16.486477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d89b5c6-6e2d-4b17-b5e5-d24638528eac admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:16.509861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:16.513117 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:16.513432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:16.513708 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:16.517070 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:16.520131 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:16.592709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 859/1740] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:16 2022] POST /identity/v3/projects => generated 379 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:16.597382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077dd42-d043-4796-a322-7af6007eb00b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:16.622209 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:16.640526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c077dd42-d043-4796-a322-7af6007eb00b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:16.833226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:16.833873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:16.843857 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:16.844247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:16.845018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:16.855094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:16.871883 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f495ae5-c7c3-4b0a-b992-70c33ad2388a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:16.896691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd8ae5ea6ac64505b309068b04f539d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdabc959848f46caa32ef14559099997', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:16.897756 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:16.898287 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:16.898776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:16.899772 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:16.900791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:16.905068 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:16.934283 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:16.966799 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 860/1741] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 345 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:16.973175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 882/1742] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:16 2022] POST /identity/v3/users => generated 296 bytes in 376 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:16.974515 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:16.977086 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:16.998633 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156f929-22bb-4abf-b60d-6f02b5784e25 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:17.016934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b076c4-6633-4086-b643-9746485561f0 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:17.018981 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:17.019723 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.019860 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.020243 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.021203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:17.023169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:17.047545 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 883/1743] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:16 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:17.051399 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd8ae5ea6ac64505b309068b04f539d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdabc959848f46caa32ef14559099997', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:17.051586 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:17.052878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.053368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.053840 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.054715 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:17.057033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:17.074864 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9378e8bf-bee7-44b1-b931-7a92e9a2f8df admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:17.093233 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:17.093985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.094374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.094800 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] PATH_INFO: `/v3/projects/dc600acaae9a4d679cf6d304f9afc4f6/users/10be286066c846639cdcbb639f9659dc/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.141193 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc600acaae9a4d679cf6d304f9afc4f6, user_id=10be286066c846639cdcbb639f9659dc, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:17.143789 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 861/1744] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:16 2022] POST /identity/v3/projects => generated 355 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:17.143921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:17.148101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:17.194429 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 884/1745] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:17 2022] PUT /identity/v3/projects/dc600acaae9a4d679cf6d304f9afc4f6/users/10be286066c846639cdcbb639f9659dc/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:17.195414 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:17.348616 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:17.399853 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2597d0bb-9c46-45f5-9de0-f84246cc4139 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:17.400830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7056a3e7-079f-4429-8dea-ccf71f24af90 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:17.405812 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:17.406472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.406751 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.407029 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.407985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:17.409637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:17.444038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 885/1746] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:17 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:17.445394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:17.465718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a6d1fc-f0c0-4702-8e7c-1fe54e2c7a6a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:17.488791 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181d8d6-dd92-42ce-bfec-61001f773768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:17.489591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181d8d6-dd92-42ce-bfec-61001f773768 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.489866 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181d8d6-dd92-42ce-bfec-61001f773768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.490170 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181d8d6-dd92-42ce-bfec-61001f773768 admin admin] PATH_INFO: `/v3/projects/dc600acaae9a4d679cf6d304f9afc4f6/users/10be286066c846639cdcbb639f9659dc/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.499839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181d8d6-dd92-42ce-bfec-61001f773768 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc600acaae9a4d679cf6d304f9afc4f6, user_id=10be286066c846639cdcbb639f9659dc, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:17.502962 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181d8d6-dd92-42ce-bfec-61001f773768 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:17.524030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 886/1747] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:17 2022] PUT /identity/v3/projects/dc600acaae9a4d679cf6d304f9afc4f6/users/10be286066c846639cdcbb639f9659dc/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:17.544439 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53242-5517-41ee-be3e-d6e16efb2447 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.544733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53242-5517-41ee-be3e-d6e16efb2447 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.544953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d53242-5517-41ee-be3e-d6e16efb2447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.623944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-c9d53242-5517-41ee-be3e-d6e16efb2447 None None] MFA Rules not processed for user `10be286066c846639cdcbb639f9659dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:17.625254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-c9d53242-5517-41ee-be3e-d6e16efb2447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:17.656279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd8ae5ea6ac64505b309068b04f539d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdabc959848f46caa32ef14559099997', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:17.657149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.657337 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.657691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.658670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:17.658978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:17.672033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:17.754494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 862/1748] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 607 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:17.770747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:17.775064 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:17.825221 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d608d-47bd-44ba-b3f1-6793b3cdbf7d tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:17.921185 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 887/1749] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:17 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 378 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:17.922608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53242-5517-41ee-be3e-d6e16efb2447 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:17.931280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:17.931952 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:17.936784 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:17.937122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] PATH_INFO: `/v3/projects/c6d8ebef5dd54e7cae9fa076e729a997` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:17.940725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6d8ebef5dd54e7cae9fa076e729a997)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:17.942957 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:18.056642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:18.101539 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6d8ebef5dd54e7cae9fa076e729a997', 'request_id': 'req-317f99b7-1310-4218-90b7-2447fdf2e836'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.125306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6d8ebef5dd54e7cae9fa076e729a997', 'request_id': 'req-317f99b7-1310-4218-90b7-2447fdf2e836'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.148928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6d8ebef5dd54e7cae9fa076e729a997', 'request_id': 'req-317f99b7-1310-4218-90b7-2447fdf2e836'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.169726 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] The token cache is being invalidate because project c6d8ebef5dd54e7cae9fa076e729a997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:18.170488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.173298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.186920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 863/1750] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:17 2022] DELETE /identity/v3/projects/c6d8ebef5dd54e7cae9fa076e729a997 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:18.188183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:18.190434 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:18.210385 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d53242-5517-41ee-be3e-d6e16efb2447 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:18.215508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:18.348710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317f99b7-1310-4218-90b7-2447fdf2e836 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:18.368507 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4add894f-c15f-43d2-8ec5-e5f12b1a8a8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:18.369821 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add894f-c15f-43d2-8ec5-e5f12b1a8a8b service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:18.370290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add894f-c15f-43d2-8ec5-e5f12b1a8a8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:18.370719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4add894f-c15f-43d2-8ec5-e5f12b1a8a8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:18.373257 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-4add894f-c15f-43d2-8ec5-e5f12b1a8a8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:18.487266 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bd8ae5ea6ac64505b309068b04f539d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'bdabc959848f46caa32ef14559099997', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:18.491367 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:18.492346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:18.495213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] PATH_INFO: `/v3/projects/19ca1ca76edc4be589c086e914d5c560` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:18.499520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorizing `identity:delete_project(project_id=19ca1ca76edc4be589c086e914d5c560)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:18.509961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:18.545279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add894f-c15f-43d2-8ec5-e5f12b1a8a8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:18.551769 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4add894f-c15f-43d2-8ec5-e5f12b1a8a8b service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:18.584973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 864/1751] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:18 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:18.593951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:18.594302 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:18.594604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:18.651035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:18.652309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:18.695423 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19ca1ca76edc4be589c086e914d5c560', 'request_id': 'req-e2e8d16a-f27d-464c-b626-a9c8ec6be581'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.746166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19ca1ca76edc4be589c086e914d5c560', 'request_id': 'req-e2e8d16a-f27d-464c-b626-a9c8ec6be581'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.775296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19ca1ca76edc4be589c086e914d5c560', 'request_id': 'req-e2e8d16a-f27d-464c-b626-a9c8ec6be581'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.806642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] The token cache is being invalidate because project 19ca1ca76edc4be589c086e914d5c560 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:18.806944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.807920 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:18.813636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 888/1752] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:17 2022] DELETE /identity/v3/projects/19ca1ca76edc4be589c086e914d5c560 => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:18.813636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:18.816088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:18.849461 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 865/1753] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:18.860531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:18.865160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:19.023259 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e8d16a-f27d-464c-b626-a9c8ec6be581 tempest-VolumeQuotaClassesTest-577028909 tempest-VolumeQuotaClassesTest-577028909-project-admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:19.044498 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:19.045095 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.045395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.045637 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] PATH_INFO: `/v3/users/fa2a27a03f0f4bb09d69bcc3ed60fe0c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.047090 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa2a27a03f0f4bb09d69bcc3ed60fe0c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:19.050172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:19.065440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:19.078644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82ef0f5-7faa-4a07-b6bd-9f045a95c108 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:19.094894 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c337f-e148-4062-adbd-83cdd1f0fd1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:19.098664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c337f-e148-4062-adbd-83cdd1f0fd1c service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.099871 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c337f-e148-4062-adbd-83cdd1f0fd1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.100242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c337f-e148-4062-adbd-83cdd1f0fd1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.103856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d78c337f-e148-4062-adbd-83cdd1f0fd1c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:19.180244 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:19.203159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa2a27a03f0f4bb09d69bcc3ed60fe0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.233021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa2a27a03f0f4bb09d69bcc3ed60fe0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.257309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa2a27a03f0f4bb09d69bcc3ed60fe0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.258210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa2a27a03f0f4bb09d69bcc3ed60fe0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.293985 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-aeea3cdd-dce9-4cb5-93f5-504ac6011014 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa2a27a03f0f4bb09d69bcc3ed60fe0c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.317033 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 889/1754] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:18 2022] DELETE /identity/v3/users/fa2a27a03f0f4bb09d69bcc3ed60fe0c => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:19.327444 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c337f-e148-4062-adbd-83cdd1f0fd1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:19.331505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ccff-b5b2-47fc-8ca3-188c64e8c53f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.331830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ccff-b5b2-47fc-8ca3-188c64e8c53f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.332113 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6139ccff-b5b2-47fc-8ca3-188c64e8c53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.333522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c337f-e148-4062-adbd-83cdd1f0fd1c service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:19.358467 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6139ccff-b5b2-47fc-8ca3-188c64e8c53f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:19.360063 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6139ccff-b5b2-47fc-8ca3-188c64e8c53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:19.381768 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 866/1755] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:18 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:19.385924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.394089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.395610 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.469332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:19.472216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 890/1756] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:19.473278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139ccff-b5b2-47fc-8ca3-188c64e8c53f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:19.474263 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:19.494080 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6139ccff-b5b2-47fc-8ca3-188c64e8c53f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:19.511149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 867/1757] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:19.514768 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:19.515634 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.516142 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.517286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.522156 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:19.522692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:19.524552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:19.541306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:19.543379 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:19.557056 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 891/1758] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:19.561520 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:19.568229 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc769fb-23e5-45bd-a080-5f9bab6dd3f0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:19.582984 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493c5f1d-2e5f-45e9-9ed1-b682fd114337 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:19.597423 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:19.598459 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.599057 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.599493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:19.600120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.600450 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.600656 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.601297 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:19.603263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:19.605441 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] PATH_INFO: `/v3/users/fd24131ffa194365b7a6b27844c6289a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.608439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd24131ffa194365b7a6b27844c6289a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:19.613146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:19.665084 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 892/1759] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:19 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:19.665084 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:19.666493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:19.789730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:19.804495 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd24131ffa194365b7a6b27844c6289a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.815810 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1376eda-7887-489b-994a-25e4acb424ed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:19.824207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7c2258-f766-41dc-b565-85e052fb0e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:19.825217 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2258-f766-41dc-b565-85e052fb0e38 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:19.825705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2258-f766-41dc-b565-85e052fb0e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:19.826363 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7c2258-f766-41dc-b565-85e052fb0e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:19.826678 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd24131ffa194365b7a6b27844c6289a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.849687 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd24131ffa194365b7a6b27844c6289a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.894861 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd24131ffa194365b7a6b27844c6289a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.896227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd24131ffa194365b7a6b27844c6289a'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:19.904666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 868/1760] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:19 2022] DELETE /identity/v3/users/fd24131ffa194365b7a6b27844c6289a => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:19.905523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:19.907074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:19.998072 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c2258-f766-41dc-b565-85e052fb0e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:19.999830 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7c2258-f766-41dc-b565-85e052fb0e38 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:20.024454 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 893/1761] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:20.026098 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ced2-882d-4cfd-ab0d-910d0c8bb683 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.026542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ced2-882d-4cfd-ab0d-910d0c8bb683 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.026967 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b361ced2-882d-4cfd-ab0d-910d0c8bb683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.075019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b361ced2-882d-4cfd-ab0d-910d0c8bb683 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:20.076534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b361ced2-882d-4cfd-ab0d-910d0c8bb683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:20.083822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eacc595-ad2d-43e1-9ac2-01453e1d6b91 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:20.100370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 894/1762] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:20.101793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ee2ba-3db7-4ee0-8223-5809b62c2e2f None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.102087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ee2ba-3db7-4ee0-8223-5809b62c2e2f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.102368 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430ee2ba-3db7-4ee0-8223-5809b62c2e2f None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.102637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3c34ef-b399-4c6d-950b-bd457c92c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:20.103944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 895/1763] 10.222.0.39 () {54 vars in 921 bytes} [Mon Aug 8 01:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:16:20.111129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c34ef-b399-4c6d-950b-bd457c92c4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.111727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c34ef-b399-4c6d-950b-bd457c92c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.112145 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3c34ef-b399-4c6d-950b-bd457c92c4b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.112985 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c34ef-b399-4c6d-950b-bd457c92c4b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:20.115299 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3c34ef-b399-4c6d-950b-bd457c92c4b0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:20.174339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 869/1764] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:19 2022] POST /identity/v3/users => generated 293 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:20.179533 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ee2ba-3db7-4ee0-8223-5809b62c2e2f None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:20.202945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8795-48ee-4916-babb-93628014c2d7 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.203535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8795-48ee-4916-babb-93628014c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.204005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2e8795-48ee-4916-babb-93628014c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.211066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430ee2ba-3db7-4ee0-8223-5809b62c2e2f None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:20.225162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:20.226150 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.226564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.226982 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.228498 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:20.233730 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:20.240066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-da2e8795-48ee-4916-babb-93628014c2d7 None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:20.245165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-da2e8795-48ee-4916-babb-93628014c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:20.257877 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:20.268503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 896/1765] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:20.271143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:20.274458 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:20.410794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcf5953-dfb7-49ec-a031-f947f5fc2b18 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:20.424839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:20.425770 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.426231 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.426677 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.440072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 870/1766] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Aug 8 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:20.441199 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8795-48ee-4916-babb-93628014c2d7 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:20.443169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:20.444636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:20.456183 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2e8795-48ee-4916-babb-93628014c2d7 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:20.456404 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 897/1767] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:20.461522 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:20.462365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.462995 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.463383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.464167 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:20.466012 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:20.486709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 871/1768] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:20.487990 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:20.496197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:20.500993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:20.503442 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13af98-4165-4a18-ab8f-2bfa56c1c7a6 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:20.514878 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246430bf-b4a3-4812-bfb5-f80a3903568e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:20.515735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246430bf-b4a3-4812-bfb5-f80a3903568e admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.517473 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246430bf-b4a3-4812-bfb5-f80a3903568e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.517673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246430bf-b4a3-4812-bfb5-f80a3903568e admin admin] PATH_INFO: `/v3/projects/1b93cb9f96e045a1b7b3976a50e95012/users/d416fc99e9494eb7a4cd776c56a9757c/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.550850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c48e54-f7f6-4c35-82f9-34dbaf7da8e7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:20.559025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246430bf-b4a3-4812-bfb5-f80a3903568e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b93cb9f96e045a1b7b3976a50e95012, user_id=d416fc99e9494eb7a4cd776c56a9757c, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:20.569990 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb56ab7e-49fa-44ef-9e80-b0ff7a378bf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:20.570823 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56ab7e-49fa-44ef-9e80-b0ff7a378bf8 service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.571108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56ab7e-49fa-44ef-9e80-b0ff7a378bf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.571413 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb56ab7e-49fa-44ef-9e80-b0ff7a378bf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.573860 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246430bf-b4a3-4812-bfb5-f80a3903568e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:20.597010 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56ab7e-49fa-44ef-9e80-b0ff7a378bf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:20.598929 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb56ab7e-49fa-44ef-9e80-b0ff7a378bf8 service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:20.612655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 872/1769] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:20.614641 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 898/1770] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:20 2022] PUT /identity/v3/projects/1b93cb9f96e045a1b7b3976a50e95012/users/d416fc99e9494eb7a4cd776c56a9757c/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:20.624858 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909556e1-7211-47e4-bb2b-0ec4d2076aa0 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.625135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909556e1-7211-47e4-bb2b-0ec4d2076aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.625408 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909556e1-7211-47e4-bb2b-0ec4d2076aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.683150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-909556e1-7211-47e4-bb2b-0ec4d2076aa0 None None] MFA Rules not processed for user `d416fc99e9494eb7a4cd776c56a9757c`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:20.684896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-909556e1-7211-47e4-bb2b-0ec4d2076aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:20.690065 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaffa4-601c-4b88-971b-28732509d027 None None] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.690407 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaffa4-601c-4b88-971b-28732509d027 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.690693 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaaffa4-601c-4b88-971b-28732509d027 None None] PATH_INFO: `/` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.693144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 899/1771] 10.222.0.39 () {54 vars in 921 bytes} [Mon Aug 8 01:16:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:16:20.770165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4520e-2fa5-49cf-9409-be2d999869be None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:20.770318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4520e-2fa5-49cf-9409-be2d999869be None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:20.770736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4520e-2fa5-49cf-9409-be2d999869be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:20.825891 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-a8c4520e-2fa5-49cf-9409-be2d999869be None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:20.827394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-a8c4520e-2fa5-49cf-9409-be2d999869be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:20.831627 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 873/1772] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:20.832760 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909556e1-7211-47e4-bb2b-0ec4d2076aa0 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:20.953718 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:20.990609 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909556e1-7211-47e4-bb2b-0ec4d2076aa0 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:20.992194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 900/1773] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Aug 8 01:16:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:21.002587 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:21.003236 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.003513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.003793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.004531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:21.008812 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:21.060053 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:21.101927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 874/1774] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:20 2022] POST /identity/v3/projects => generated 387 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:21.103539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4520e-2fa5-49cf-9409-be2d999869be None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:21.133881 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4520e-2fa5-49cf-9409-be2d999869be None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:21.286167 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:21.287094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.287563 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.288069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.288924 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:21.291174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:21.371305 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 901/1775] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:21 2022] POST /identity/v3/users => generated 300 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:21.375220 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:21.386178 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:21.390172 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c763db5-ebf1-4d8f-98b3-30ac0f1d9acf admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:21.399777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:21.402188 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.402705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.403150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.403976 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:21.405848 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:21.417866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 875/1776] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:21.421839 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:21.437124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc51403-3874-4a15-8750-aaa90edcdc66 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:21.444560 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:21.445503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.445928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.446466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] PATH_INFO: `/v3/projects/db6d303a6ec3402e8c9fb8612a38914a/users/de43ee9fb4dd4a8cbfe70a3f47b47196/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.469736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6d303a6ec3402e8c9fb8612a38914a, user_id=de43ee9fb4dd4a8cbfe70a3f47b47196, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:21.473875 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:21.499680 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 876/1777] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:21 2022] PUT /identity/v3/projects/db6d303a6ec3402e8c9fb8612a38914a/users/de43ee9fb4dd4a8cbfe70a3f47b47196/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:21.502249 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:21.597055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0472e206-cb00-4690-b354-a4d0e92caaed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:21.716542 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb0f4d7-06fd-4e24-837e-6111aa0cf8c1 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:21.743688 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:21.755974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.755974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.755974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.755974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:21.755974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:21.767604 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 877/1778] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:21.771767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:21.788814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac97ab5a-555c-43a4-ac7d-982870197ce6 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:21.793897 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94292f0-f7d1-40f5-9d2d-be0c324287c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:21.794655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94292f0-f7d1-40f5-9d2d-be0c324287c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.795232 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94292f0-f7d1-40f5-9d2d-be0c324287c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.795439 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94292f0-f7d1-40f5-9d2d-be0c324287c8 admin admin] PATH_INFO: `/v3/projects/db6d303a6ec3402e8c9fb8612a38914a/users/de43ee9fb4dd4a8cbfe70a3f47b47196/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.799701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94292f0-f7d1-40f5-9d2d-be0c324287c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db6d303a6ec3402e8c9fb8612a38914a, user_id=de43ee9fb4dd4a8cbfe70a3f47b47196, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:21.804523 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94292f0-f7d1-40f5-9d2d-be0c324287c8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:21.811074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:21.812176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.812692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.813393 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.829770 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 878/1779] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:21 2022] PUT /identity/v3/projects/db6d303a6ec3402e8c9fb8612a38914a/users/de43ee9fb4dd4a8cbfe70a3f47b47196/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:21.832308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:21.833129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:21.833129 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:21.835874 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:21.838410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:21.851233 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 902/1780] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 466 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:21.893349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] MFA Rules not processed for user `de43ee9fb4dd4a8cbfe70a3f47b47196`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:21.895449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:22.033333 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:22.035000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:22.041968 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:22.042576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 879/1781] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:21 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:22.122265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d190bd-42d5-4a2f-928e-c2447eb477b9 service nova] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:22.207456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:22.208463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:22.208932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:22.209445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:22.223659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:22.225756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:22.238819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:22.240533 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:22.247595 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 903/1782] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:22 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:22.313062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:22.370796 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc110d6-e70d-42b0-aae7-68f63bba5a31 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:22.375815 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:22.376865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:22.377152 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:22.377427 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] PATH_INFO: `/v3/projects/9007910fd1534294ae41dd08381aab4f` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:22.379005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9007910fd1534294ae41dd08381aab4f)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:22.380992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:22.442622 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9007910fd1534294ae41dd08381aab4f', 'request_id': 'req-a30d527a-5c24-4af1-ae02-90630ef45edf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.451261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9007910fd1534294ae41dd08381aab4f', 'request_id': 'req-a30d527a-5c24-4af1-ae02-90630ef45edf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.469219 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9007910fd1534294ae41dd08381aab4f', 'request_id': 'req-a30d527a-5c24-4af1-ae02-90630ef45edf'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.491431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] The token cache is being invalidate because project 9007910fd1534294ae41dd08381aab4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:22.491998 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.492948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.495197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 880/1783] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:22 2022] DELETE /identity/v3/projects/9007910fd1534294ae41dd08381aab4f => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:22.499358 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:22.512979 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec4d274-8835-4122-aaa0-d741e11b3680 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:22.595210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:22.595863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:22.596146 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:22.596426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] PATH_INFO: `/v3/users/bd8ae5ea6ac64505b309068b04f539d5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:22.597692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd8ae5ea6ac64505b309068b04f539d5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:22.600652 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:22.679227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd8ae5ea6ac64505b309068b04f539d5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.693711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd8ae5ea6ac64505b309068b04f539d5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.706706 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:22.708867 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:22.710611 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd8ae5ea6ac64505b309068b04f539d5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.711398 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd8ae5ea6ac64505b309068b04f539d5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.714765 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:22.732911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8b785018-5e54-4a96-a2e4-10574f802794 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd8ae5ea6ac64505b309068b04f539d5'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.749739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30d527a-5c24-4af1-ae02-90630ef45edf admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:22.753037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 904/1784] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:22 2022] DELETE /identity/v3/users/bd8ae5ea6ac64505b309068b04f539d5 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:22.851325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:22.852430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:22.853333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:22.853758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] PATH_INFO: `/v3/projects/f6f6c6e4bac343729c4b95a91da26332` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:22.856261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6f6c6e4bac343729c4b95a91da26332)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:22.858411 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:22.949655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6f6c6e4bac343729c4b95a91da26332', 'request_id': 'req-9b90df46-d244-4113-af4d-afb8c968d60d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.960640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:22.962845 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6f6c6e4bac343729c4b95a91da26332', 'request_id': 'req-9b90df46-d244-4113-af4d-afb8c968d60d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:22.978569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6f6c6e4bac343729c4b95a91da26332', 'request_id': 'req-9b90df46-d244-4113-af4d-afb8c968d60d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.008942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] The token cache is being invalidate because project f6f6c6e4bac343729c4b95a91da26332 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:23.008942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.008942 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.016005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 881/1785] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:22 2022] DELETE /identity/v3/projects/f6f6c6e4bac343729c4b95a91da26332 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:23.016936 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591ebb-86f7-4f79-8573-c63983688665 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.017420 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591ebb-86f7-4f79-8573-c63983688665 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.017502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41591ebb-86f7-4f79-8573-c63983688665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.075238 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-41591ebb-86f7-4f79-8573-c63983688665 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:23.079328 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-41591ebb-86f7-4f79-8573-c63983688665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.214033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.216521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.282277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 905/1786] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:23.293009 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc297d3-6198-4df0-b4da-4ecd8f89cd87 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.293279 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc297d3-6198-4df0-b4da-4ecd8f89cd87 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.293703 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc297d3-6198-4df0-b4da-4ecd8f89cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.336162 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-ecc297d3-6198-4df0-b4da-4ecd8f89cd87 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:23.339909 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ecc297d3-6198-4df0-b4da-4ecd8f89cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.341109 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b90df46-d244-4113-af4d-afb8c968d60d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.357298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.358017 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.359106 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.360961 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] PATH_INFO: `/v3/users/d416fc99e9494eb7a4cd776c56a9757c` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.361743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 906/1787] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:23.365602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d416fc99e9494eb7a4cd776c56a9757c)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.365762 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc297d3-6198-4df0-b4da-4ecd8f89cd87 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.369611 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.378255 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc297d3-6198-4df0-b4da-4ecd8f89cd87 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.383074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.383685 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.384134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.384409 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.385068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:23.385375 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.387054 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.400683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 907/1788] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:16:23.405000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.420618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edab4611-c0f3-415e-bf4b-783a19a5f3ee admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.427152 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.428133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.428695 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.429149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.430608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.432143 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.448144 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd416fc99e9494eb7a4cd776c56a9757c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.460788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd416fc99e9494eb7a4cd776c56a9757c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.471694 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd416fc99e9494eb7a4cd776c56a9757c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.476296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 908/1789] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/projects => generated 405 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:23.480584 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.492900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd416fc99e9494eb7a4cd776c56a9757c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.493656 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-916a7f49-1ee2-4e58-b5dc-44a96ec187fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd416fc99e9494eb7a4cd776c56a9757c'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.504374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 882/1790] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:23 2022] DELETE /identity/v3/users/d416fc99e9494eb7a4cd776c56a9757c => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:23.511644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.511945 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.512310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.547383 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:23.549019 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.579688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3761ff4f-8df2-43e7-9288-00457242ae2f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.630866 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 883/1791] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:23.632498 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:23.635195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.636736 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.645325 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:23.649286 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75095db-9e88-4a70-8225-9fe0374134bc None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.654069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.654700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.654977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.655249 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.655873 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.658132 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.660031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.661036 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.661594 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.661878 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] PATH_INFO: `/v3/projects/bdabc959848f46caa32ef14559099997` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.663122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdabc959848f46caa32ef14559099997)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.665087 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.683787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 909/1792] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/users => generated 303 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:23.685105 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.686727 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.720793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdabc959848f46caa32ef14559099997', 'request_id': 'req-95913d39-88c8-46c8-bf1c-a6800bd2358f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.727104 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdabc959848f46caa32ef14559099997', 'request_id': 'req-95913d39-88c8-46c8-bf1c-a6800bd2358f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.738432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdabc959848f46caa32ef14559099997', 'request_id': 'req-95913d39-88c8-46c8-bf1c-a6800bd2358f'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.750333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] The token cache is being invalidate because project bdabc959848f46caa32ef14559099997 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:23.750689 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.751395 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:23.752037 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fab819c-2a2c-4d0f-929a-3e9a11d351b7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.753698 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 884/1793] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:23 2022] DELETE /identity/v3/projects/bdabc959848f46caa32ef14559099997 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:23.754448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.755731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.810434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c276eb-802f-4dd3-907e-3ce1a809a682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.811058 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c276eb-802f-4dd3-907e-3ce1a809a682 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.811446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c276eb-802f-4dd3-907e-3ce1a809a682 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.811743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c276eb-802f-4dd3-907e-3ce1a809a682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.813645 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-41c276eb-802f-4dd3-907e-3ce1a809a682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.827993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95913d39-88c8-46c8-bf1c-a6800bd2358f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.828253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c276eb-802f-4dd3-907e-3ce1a809a682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.829952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c276eb-802f-4dd3-907e-3ce1a809a682 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.833639 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.834590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.835503 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.835797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.837089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.838586 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.840189 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 910/1794] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:23.841954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db98f-a63b-487b-9809-212d0f10351f None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.841954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db98f-a63b-487b-9809-212d0f10351f None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.841954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530db98f-a63b-487b-9809-212d0f10351f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.857880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 885/1795] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:23.861877 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.870758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-530db98f-a63b-487b-9809-212d0f10351f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:23.871983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-530db98f-a63b-487b-9809-212d0f10351f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.875082 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ebebbd-8a50-45e5-a02e-037f0b0bff4b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.881440 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 911/1796] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:23.882787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.883418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.883701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.883977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.884635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.886297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.888944 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533bc5b-f37c-4f3a-9c88-53cd3c45e62a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.889370 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533bc5b-f37c-4f3a-9c88-53cd3c45e62a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.889991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533bc5b-f37c-4f3a-9c88-53cd3c45e62a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.902044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 886/1797] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:23 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:23.903201 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.915636 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6533bc5b-f37c-4f3a-9c88-53cd3c45e62a None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:23.915903 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f24e3b-af27-4b71-bf6d-bdeab1dd0197 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.917234 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6533bc5b-f37c-4f3a-9c88-53cd3c45e62a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:23.922527 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f504b8-0fbc-4225-b43f-887b5d93a8b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.923896 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f504b8-0fbc-4225-b43f-887b5d93a8b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.924274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f504b8-0fbc-4225-b43f-887b5d93a8b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.924554 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f504b8-0fbc-4225-b43f-887b5d93a8b8 admin admin] PATH_INFO: `/v3/projects/3596ceaab3264a9188d542f040c40e0a/users/5cd91a8c374b4003ad2663a5104044a2/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.929918 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 912/1798] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:23.934476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533bc5b-f37c-4f3a-9c88-53cd3c45e62a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.946856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533bc5b-f37c-4f3a-9c88-53cd3c45e62a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:23.952838 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:23.953705 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:23.954856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:23.955235 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:23.968949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:23.968949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.968949 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.972907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f504b8-0fbc-4225-b43f-887b5d93a8b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3596ceaab3264a9188d542f040c40e0a, user_id=5cd91a8c374b4003ad2663a5104044a2, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:23.975900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f504b8-0fbc-4225-b43f-887b5d93a8b8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:23.977913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 913/1799] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:23.978839 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:23.990786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0387891-7418-4602-ac17-3c610c279402 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.006228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 887/1800] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:23 2022] PUT /identity/v3/projects/3596ceaab3264a9188d542f040c40e0a/users/5cd91a8c374b4003ad2663a5104044a2/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:24.007816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3aa7f-9f6f-42a5-8c09-2de4eb628264 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.008100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3aa7f-9f6f-42a5-8c09-2de4eb628264 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.008372 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3aa7f-9f6f-42a5-8c09-2de4eb628264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.039690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-32c3aa7f-9f6f-42a5-8c09-2de4eb628264 None None] MFA Rules not processed for user `5cd91a8c374b4003ad2663a5104044a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:24.041015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-32c3aa7f-9f6f-42a5-8c09-2de4eb628264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.072395 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.074089 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.074516 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.074793 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.075582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.077686 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.088521 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:24.103594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:24.123854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 914/1801] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:23 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:24.128568 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.132187 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 888/1802] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:24.133407 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3aa7f-9f6f-42a5-8c09-2de4eb628264 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.148044 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3aa7f-9f6f-42a5-8c09-2de4eb628264 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.210712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add443d2-f608-4551-b505-49484c2f08ec admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.213084 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.213737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.214014 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.214356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.214980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.216462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.216969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.217073 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.217344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.217618 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.218286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.220277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.250305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 889/1803] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:24 2022] POST /identity/v3/projects => generated 405 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:24.250517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 915/1804] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:24 2022] POST /identity/v3/users => generated 293 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:24.250654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.250750 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.255053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.264887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96274502-0c5c-4515-b737-78faec5a2f10 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.314649 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40189e2a-bb55-4082-a017-875a11dfc474 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.319279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.319920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.320200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.320470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] PATH_INFO: `/v3/projects/1b93cb9f96e045a1b7b3976a50e95012` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.321573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b93cb9f96e045a1b7b3976a50e95012)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.321825 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.322475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.322756 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.323040 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.323508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.323651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.325578 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.348348 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 916/1805] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:24 2022] POST /identity/v3/users => generated 309 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:24.349630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.365197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0ac2-9644-4a1b-8bdb-48062b636535 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.383597 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b93cb9f96e045a1b7b3976a50e95012', 'request_id': 'req-c0cadd6d-9680-478b-853d-b7d748974169'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.389137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b93cb9f96e045a1b7b3976a50e95012', 'request_id': 'req-c0cadd6d-9680-478b-853d-b7d748974169'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.398342 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b93cb9f96e045a1b7b3976a50e95012', 'request_id': 'req-c0cadd6d-9680-478b-853d-b7d748974169'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.399766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:24.413710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] The token cache is being invalidate because project 1b93cb9f96e045a1b7b3976a50e95012 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:24.414024 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.414721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.419478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 890/1806] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:24 2022] DELETE /identity/v3/projects/1b93cb9f96e045a1b7b3976a50e95012 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:24.419478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.419478 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.434974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.435631 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.436017 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.436307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.437055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.438904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.448921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 917/1807] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:24.449852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.451848 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.464190 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b61614-140b-45fb-8440-d7934277bdd1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.469071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.469706 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.470161 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.470289 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] PATH_INFO: `/v3/users/de43ee9fb4dd4a8cbfe70a3f47b47196` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.471525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de43ee9fb4dd4a8cbfe70a3f47b47196)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.473498 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.478028 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:24.486471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cadd6d-9680-478b-853d-b7d748974169 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.492192 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.492814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.493093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.493371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.494022 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.495673 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.509819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 891/1808] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:24.509819 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.511944 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.525980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed51d26-f1c9-4f7e-9c3a-f31bd8af332f admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.531260 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.531910 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.532195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.532506 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.533112 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.535021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.536149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de43ee9fb4dd4a8cbfe70a3f47b47196'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.543840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de43ee9fb4dd4a8cbfe70a3f47b47196'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.546680 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 892/1809] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:24.548100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.558972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce90dc95-96db-4fdf-b67f-40a94edc8519 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.559257 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de43ee9fb4dd4a8cbfe70a3f47b47196'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.559970 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de43ee9fb4dd4a8cbfe70a3f47b47196'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.564402 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.565184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.565558 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.565926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] PATH_INFO: `/v3/projects/f8087b7e756541ea966ce5d561dd9fa5/users/05a1f71fe6b74c4590b4cf83c0d0f9f7/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.577509 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de43ee9fb4dd4a8cbfe70a3f47b47196'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:24.584587 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 918/1810] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:24 2022] DELETE /identity/v3/users/de43ee9fb4dd4a8cbfe70a3f47b47196 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:24.585325 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.586822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.589066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8087b7e756541ea966ce5d561dd9fa5, user_id=05a1f71fe6b74c4590b4cf83c0d0f9f7, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.591842 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.614364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 893/1811] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:24 2022] PUT /identity/v3/projects/f8087b7e756541ea966ce5d561dd9fa5/users/05a1f71fe6b74c4590b4cf83c0d0f9f7/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:24.616448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.619191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.663766 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f160df-fb31-4f03-a509-9de6fa0fe203 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.707319 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83055de0-fdd6-4094-bd5f-77c14464334a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.713643 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.714519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.714962 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.715430 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.716077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.718442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.730629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 894/1812] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:24.731622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88a5a9-f06a-461f-b24a-18012e911128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.732451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88a5a9-f06a-461f-b24a-18012e911128 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.732731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88a5a9-f06a-461f-b24a-18012e911128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.733003 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88a5a9-f06a-461f-b24a-18012e911128 admin admin] PATH_INFO: `/v3/projects/516f4c43dee3439b8a6c85bbac3015be/users/52e563eb752a4b70a115909a9719c8dc/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.734686 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.747203 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72593713-51ac-4231-9e0c-8219842ac6ca admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:24.750845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88a5a9-f06a-461f-b24a-18012e911128 admin admin] RBAC: Authorizing `identity:create_grant(project_id=516f4c43dee3439b8a6c85bbac3015be, user_id=52e563eb752a4b70a115909a9719c8dc, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.753130 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cf1a82-7989-4106-9982-e8b68d4768e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:24.754015 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1a82-7989-4106-9982-e8b68d4768e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.754149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88a5a9-f06a-461f-b24a-18012e911128 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.754508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1a82-7989-4106-9982-e8b68d4768e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.754965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cf1a82-7989-4106-9982-e8b68d4768e3 admin admin] PATH_INFO: `/v3/projects/f8087b7e756541ea966ce5d561dd9fa5/users/05a1f71fe6b74c4590b4cf83c0d0f9f7/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.757989 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1a82-7989-4106-9982-e8b68d4768e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8087b7e756541ea966ce5d561dd9fa5, user_id=05a1f71fe6b74c4590b4cf83c0d0f9f7, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:24.760900 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cf1a82-7989-4106-9982-e8b68d4768e3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:24.786181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 895/1813] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:24 2022] PUT /identity/v3/projects/f8087b7e756541ea966ce5d561dd9fa5/users/05a1f71fe6b74c4590b4cf83c0d0f9f7/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:24.792690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.793815 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.794309 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.799226 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 919/1814] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:24 2022] PUT /identity/v3/projects/516f4c43dee3439b8a6c85bbac3015be/users/52e563eb752a4b70a115909a9719c8dc/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:24.810552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ef093-3f77-4428-8ebf-463aecea003a None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:24.810833 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ef093-3f77-4428-8ebf-463aecea003a None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:24.811110 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689ef093-3f77-4428-8ebf-463aecea003a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:24.833498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] MFA Rules not processed for user `05a1f71fe6b74c4590b4cf83c0d0f9f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:24.835099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.838392 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:24.844527 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-689ef093-3f77-4428-8ebf-463aecea003a None None] MFA Rules not processed for user `52e563eb752a4b70a115909a9719c8dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:24.848126 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-689ef093-3f77-4428-8ebf-463aecea003a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.865751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:24.920732 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 896/1815] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:24.931417 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 920/1816] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:24 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:24.932320 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:24.933892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:24.935926 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ef093-3f77-4428-8ebf-463aecea003a None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.039418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689ef093-3f77-4428-8ebf-463aecea003a None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.051469 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.052236 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.052606 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.052971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.053965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.056845 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.060851 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca00f-e9cc-442a-9262-53c20bd86620 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.068640 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.069304 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.069690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.069967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.083747 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.085470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.096277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 921/1817] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:24 2022] POST /identity/v3/projects => generated 387 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:25.100442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 897/1818] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:24 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:25.101574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.157397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.159001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:25.185322 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fef1fe2b-1322-4645-ab50-2084b815eaf1 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.221961 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b0414b-1a72-4634-9aef-bcd87952c6e1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.229344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.230335 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.230616 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.230892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.231599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.233557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.261356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 922/1819] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:25.262272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.272532 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.273060 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bffb637-dab1-41e1-ad42-a0e3792892f1 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.273181 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.273464 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.273739 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] PATH_INFO: `/v3/projects/db6d303a6ec3402e8c9fb8612a38914a` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.274901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=db6d303a6ec3402e8c9fb8612a38914a)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.276901 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.278197 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.278872 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.279219 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.279493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.280134 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.281885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.292343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 923/1820] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:25.296425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.307196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76a41c0-a904-402e-b6aa-60c739b56f40 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.312225 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.312857 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.313181 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.313459 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.314253 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.315858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.317361 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:25.326737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db6d303a6ec3402e8c9fb8612a38914a', 'request_id': 'req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:25.330570 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 924/1821] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:25.333493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db6d303a6ec3402e8c9fb8612a38914a', 'request_id': 'req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:25.334208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.341709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db6d303a6ec3402e8c9fb8612a38914a', 'request_id': 'req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:25.344075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15913505-8f32-4024-ad14-ef63fc7ae94f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.344645 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:25.355738 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] The token cache is being invalidate because project db6d303a6ec3402e8c9fb8612a38914a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:25.356255 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:25.357660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-6bc3055e-f7c0-41ef-803f-bdf8e843a4fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:25.359619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 898/1822] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:25 2022] DELETE /identity/v3/projects/db6d303a6ec3402e8c9fb8612a38914a => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:25.364211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f91c01-f90c-487b-96b3-345fdafeab0d None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.364500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f91c01-f90c-487b-96b3-345fdafeab0d None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.364777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f91c01-f90c-487b-96b3-345fdafeab0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.385435 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a6f91c01-f90c-487b-96b3-345fdafeab0d None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:25.386740 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a6f91c01-f90c-487b-96b3-345fdafeab0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:25.406642 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e54c3a5-e06c-4e43-9beb-7738d5c6a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.411497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54c3a5-e06c-4e43-9beb-7738d5c6a756 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.411497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54c3a5-e06c-4e43-9beb-7738d5c6a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.411497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e54c3a5-e06c-4e43-9beb-7738d5c6a756 admin admin] PATH_INFO: `/v3/projects/86bad712c13a4295b72f42d2f62e960a/users/8fb40ee4fe494513ae965969138ff31d/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.425638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54c3a5-e06c-4e43-9beb-7738d5c6a756 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86bad712c13a4295b72f42d2f62e960a, user_id=8fb40ee4fe494513ae965969138ff31d, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.428679 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e54c3a5-e06c-4e43-9beb-7738d5c6a756 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.443325 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 925/1823] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:25 2022] PUT /identity/v3/projects/86bad712c13a4295b72f42d2f62e960a/users/8fb40ee4fe494513ae965969138ff31d/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:25.450079 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 899/1824] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:25.457091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.457091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.457091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.458965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d0df8-1882-4baf-ba6c-24d11bccadc5 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.459324 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d0df8-1882-4baf-ba6c-24d11bccadc5 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.459661 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1d0df8-1882-4baf-ba6c-24d11bccadc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.480042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-3e1d0df8-1882-4baf-ba6c-24d11bccadc5 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:25.481242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3e1d0df8-1882-4baf-ba6c-24d11bccadc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:25.481964 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] MFA Rules not processed for user `8fb40ee4fe494513ae965969138ff31d`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:25.483158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:25.538954 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 900/1825] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:25.543164 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d0df8-1882-4baf-ba6c-24d11bccadc5 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.551165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 926/1826] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:25.553023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1d0df8-1882-4baf-ba6c-24d11bccadc5 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.555476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.556840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:25.558432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.559042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.559353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.559624 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.560273 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:25.560602 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.562296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.570379 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfeee798-1b4e-41b6-bc93-78501abe1d51 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.574955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 901/1827] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:25.575658 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.576276 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.576548 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.576818 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.577451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.579389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.579519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.589116 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27791110-9071-4c66-ba5a-d426601734ca admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.593967 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.594684 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.594958 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.595227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.595850 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.597766 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.607643 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 927/1828] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:25.611701 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.630078 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 902/1829] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:25.631195 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.663326 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:25.679518 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d34618d-436c-4aad-a0ad-21282ec6468a admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.692547 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aff16d5-9deb-48f6-8f93-83930a4dae3b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.697243 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.697854 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.698165 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.698437 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.699063 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.700982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.709931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:25.724098 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 903/1830] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:25.728793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.736629 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.737357 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.737735 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.738192 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.738906 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.739754 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db15375-abe5-4380-a7d1-bd377ef98002 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.741020 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.744348 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.744941 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.745215 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.745487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.746152 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.747714 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.759029 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 904/1831] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:25.763120 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.763574 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 928/1832] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/users => generated 299 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:25.768823 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.776136 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbfa0d6-ff27-47b8-979b-a9fdb91232eb admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.781163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8db05c-a90c-4f4d-ac57-efbcd4f86696 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.787173 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.787929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.788400 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.788524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.788794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.789551 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.789712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.789822 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.790274 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.790930 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.791617 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.792598 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.806171 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 929/1833] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:25.811765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 905/1834] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:25.811893 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.812802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.821195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc56648-c46f-409f-b235-d07abbedff3e admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.823872 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2547b76d-a0ca-4a64-b64c-2bc945f213af admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.826194 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.826943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.827295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.827672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] PATH_INFO: `/v3/projects/d293ffc3cc244ee29b4dfaf5d8b44aa6/users/32c7a8bd26a3428482d1a3c13a1299d5/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.829758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4fea42-4054-4fee-9ceb-9553f0230187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:25.830499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fea42-4054-4fee-9ceb-9553f0230187 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.830767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fea42-4054-4fee-9ceb-9553f0230187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.831036 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4fea42-4054-4fee-9ceb-9553f0230187 admin admin] PATH_INFO: `/v3/projects/1c16d792305e4fd39c10a5c5daedea2b/users/ec28de6450bf443cab9312e03728c83c/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.844330 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d293ffc3cc244ee29b4dfaf5d8b44aa6, user_id=32c7a8bd26a3428482d1a3c13a1299d5, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.847096 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.848820 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fea42-4054-4fee-9ceb-9553f0230187 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c16d792305e4fd39c10a5c5daedea2b, user_id=ec28de6450bf443cab9312e03728c83c, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:25.852804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4fea42-4054-4fee-9ceb-9553f0230187 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:25.864551 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 930/1835] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:25 2022] PUT /identity/v3/projects/d293ffc3cc244ee29b4dfaf5d8b44aa6/users/32c7a8bd26a3428482d1a3c13a1299d5/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:25.868247 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:25.869593 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 906/1836] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:25 2022] PUT /identity/v3/projects/1c16d792305e4fd39c10a5c5daedea2b/users/ec28de6450bf443cab9312e03728c83c/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:25.880550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890408fe-3b44-4ba4-b4dd-b6670c4465b4 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:25.881055 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890408fe-3b44-4ba4-b4dd-b6670c4465b4 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:25.881564 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890408fe-3b44-4ba4-b4dd-b6670c4465b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:25.912691 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-890408fe-3b44-4ba4-b4dd-b6670c4465b4 None None] MFA Rules not processed for user `ec28de6450bf443cab9312e03728c83c`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:25.913951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-890408fe-3b44-4ba4-b4dd-b6670c4465b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:25.942657 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a039ce6-c3c9-4451-8207-5cad47807cfd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:25.986415 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 907/1837] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:25.990666 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890408fe-3b44-4ba4-b4dd-b6670c4465b4 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.001324 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:26.013733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.014720 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.015220 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.015594 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.016434 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.018218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.028956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 931/1838] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:26.034883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.048221 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10afb741-2926-4cba-90aa-9012d1837676 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.054066 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e3b9db-0461-4517-9718-d2f0c510d896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.054910 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3b9db-0461-4517-9718-d2f0c510d896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.055261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3b9db-0461-4517-9718-d2f0c510d896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.055597 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e3b9db-0461-4517-9718-d2f0c510d896 admin admin] PATH_INFO: `/v3/projects/d293ffc3cc244ee29b4dfaf5d8b44aa6/users/32c7a8bd26a3428482d1a3c13a1299d5/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.058085 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3b9db-0461-4517-9718-d2f0c510d896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d293ffc3cc244ee29b4dfaf5d8b44aa6, user_id=32c7a8bd26a3428482d1a3c13a1299d5, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.060732 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e3b9db-0461-4517-9718-d2f0c510d896 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.062327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890408fe-3b44-4ba4-b4dd-b6670c4465b4 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.067595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.068479 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.068936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.069375 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.070212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.072526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.082140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 932/1839] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:26 2022] PUT /identity/v3/projects/d293ffc3cc244ee29b4dfaf5d8b44aa6/users/32c7a8bd26a3428482d1a3c13a1299d5/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:26.086376 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.086736 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.087082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.120607 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 908/1840] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:25 2022] POST /identity/v3/projects => generated 383 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:26.123203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] MFA Rules not processed for user `32c7a8bd26a3428482d1a3c13a1299d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:26.124619 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:26.128293 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.152212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:26.211148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176ae281-8462-454c-b0b0-6b728fb01cfd admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.214802 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 933/1841] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:26.221338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.222272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.222614 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.222951 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.223647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.225869 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.226340 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.227807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:26.253118 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 909/1842] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:26 2022] POST /identity/v3/users => generated 298 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:26.257432 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.268798 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71e37e0-f446-4b5c-a858-5edfe22e1780 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.274864 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.276298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.276720 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.277149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.277999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.279629 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.290331 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 910/1843] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:26.294364 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.298200 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501e650a-8828-4eec-bef0-d0ffba6b3bbb None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.303074 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.303583 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.303914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.304245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.307681 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e51e1e-e355-4b54-be2d-22d901afab24 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.312983 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.313972 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.314276 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.314572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] PATH_INFO: `/v3/projects/3942b2e44b604fcfa938e25bb3dc29f3/users/01efb9ca14a849289d7dc28865e30076/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.315427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.318245 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.330651 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 934/1844] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:26 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:26.331621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=3942b2e44b604fcfa938e25bb3dc29f3, user_id=01efb9ca14a849289d7dc28865e30076, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.334365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.351499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 911/1845] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:26 2022] PUT /identity/v3/projects/3942b2e44b604fcfa938e25bb3dc29f3/users/01efb9ca14a849289d7dc28865e30076/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:26.356042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.367784 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9b6113-00f7-488f-bae7-e7635812542e service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.434498 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab355ab-43ac-48c2-8606-ef233f87bca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.435108 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab355ab-43ac-48c2-8606-ef233f87bca2 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.435426 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab355ab-43ac-48c2-8606-ef233f87bca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.435771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab355ab-43ac-48c2-8606-ef233f87bca2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.436562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab355ab-43ac-48c2-8606-ef233f87bca2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.438561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab355ab-43ac-48c2-8606-ef233f87bca2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.452467 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 935/1846] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:26.453588 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.466520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea90817-4184-4f9f-9638-71af447d49ea admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.471713 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.472575 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.473011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.473290 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] PATH_INFO: `/v3/projects/3942b2e44b604fcfa938e25bb3dc29f3/users/01efb9ca14a849289d7dc28865e30076/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.475374 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3942b2e44b604fcfa938e25bb3dc29f3, user_id=01efb9ca14a849289d7dc28865e30076, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.485701 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.497135 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 912/1847] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:26 2022] PUT /identity/v3/projects/3942b2e44b604fcfa938e25bb3dc29f3/users/01efb9ca14a849289d7dc28865e30076/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:26.508572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce09cfc-5f48-4707-be1e-de1e64ffcb88 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.508858 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce09cfc-5f48-4707-be1e-de1e64ffcb88 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.509088 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce09cfc-5f48-4707-be1e-de1e64ffcb88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.517109 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:26.544419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-fce09cfc-5f48-4707-be1e-de1e64ffcb88 None None] MFA Rules not processed for user `01efb9ca14a849289d7dc28865e30076`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:26.545671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-fce09cfc-5f48-4707-be1e-de1e64ffcb88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:26.621682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 936/1848] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:26.758508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:26.823548 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c8b173-b9d6-436f-b777-c4fcdab7feb8 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:26.830305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:26.830936 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:26.831214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:26.831477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:26.844312 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:26.846305 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:26.856094 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 913/1849] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:26 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:27.011175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce09cfc-5f48-4707-be1e-de1e64ffcb88 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:27.021198 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce09cfc-5f48-4707-be1e-de1e64ffcb88 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:27.024965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:27.025673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:27.025952 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:27.026274 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:27.085502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:27.087006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:27.097091 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 937/1850] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:27.194233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:27.203196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb209b5-1032-428f-8752-c553ec3824bf service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:27.207487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8d747-067b-427d-9983-fb57ce5f83cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:27.208089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d747-067b-427d-9983-fb57ce5f83cb service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:27.208365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d747-067b-427d-9983-fb57ce5f83cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:27.208634 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8d747-067b-427d-9983-fb57ce5f83cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:27.210716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-2cf8d747-067b-427d-9983-fb57ce5f83cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:27.272982 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8d747-067b-427d-9983-fb57ce5f83cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:27.274365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf8d747-067b-427d-9983-fb57ce5f83cb service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:27.284184 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 914/1851] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:27.479378 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:27.484005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:27.587405 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9e9db0-d5a3-4ed8-9530-5598dde2a851 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:27.592006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:27.593292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:27.593292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:27.593292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] PATH_INFO: `/v3/users/5cd91a8c374b4003ad2663a5104044a2` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:27.595354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5cd91a8c374b4003ad2663a5104044a2)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:27.597406 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:27.647731 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:27.690160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5cd91a8c374b4003ad2663a5104044a2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:27.702468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5cd91a8c374b4003ad2663a5104044a2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:27.717005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5cd91a8c374b4003ad2663a5104044a2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:27.717876 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5cd91a8c374b4003ad2663a5104044a2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:27.741807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5cd91a8c374b4003ad2663a5104044a2'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:27.756220 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 938/1852] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:27 2022] DELETE /identity/v3/users/5cd91a8c374b4003ad2663a5104044a2 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:27.757856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:27.758339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:27.758915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:27.772531 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:27.793716 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:27.795371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:27.806382 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:27.807885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:27.879730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 915/1853] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:27.889689 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4835422a-94d4-44ec-ac9a-c3190824fb2c admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:27.897574 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:27.898140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:27.899016 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:27.899161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:27.899517 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:27.899815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] PATH_INFO: `/v3/users/ec28de6450bf443cab9312e03728c83c` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:27.901053 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec28de6450bf443cab9312e03728c83c)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:27.903292 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:27.977510 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec28de6450bf443cab9312e03728c83c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:27.979333 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b6621-df8d-4ba5-ac52-5cbc700986ca None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:27.985272 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec28de6450bf443cab9312e03728c83c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:27.992787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0a26d1-0865-4a68-a514-dc7e89b9cb38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:27.993999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a26d1-0865-4a68-a514-dc7e89b9cb38 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:27.994339 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a26d1-0865-4a68-a514-dc7e89b9cb38 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:27.994654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0a26d1-0865-4a68-a514-dc7e89b9cb38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:28.006239 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a26d1-0865-4a68-a514-dc7e89b9cb38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:28.007230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec28de6450bf443cab9312e03728c83c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:28.007642 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0a26d1-0865-4a68-a514-dc7e89b9cb38 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:28.011024 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec28de6450bf443cab9312e03728c83c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:28.019496 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 916/1854] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:28.026210 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec28de6450bf443cab9312e03728c83c'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:28.033102 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 939/1855] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:27 2022] DELETE /identity/v3/users/ec28de6450bf443cab9312e03728c83c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:28.037814 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:28.038046 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:28.038356 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:28.059002 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:28.060482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:28.123947 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 917/1856] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:28.147505 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:28.149782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:28.212882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:28.255738 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c58969c-33f6-4b5f-b21a-917333195655 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:28.259682 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:28.260299 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:28.260582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:28.260855 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:28.272826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:28.274463 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:28.285196 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 940/1857] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:29.177804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:29.180038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:29.202508 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c20dc-3c09-456a-9007-716700062996 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:29.208370 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:29.209256 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:29.209690 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:29.210137 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] PATH_INFO: `/v3/projects/1c16d792305e4fd39c10a5c5daedea2b` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:29.211526 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c16d792305e4fd39c10a5c5daedea2b)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:29.215005 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:29.284804 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:29.296207 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:29.299271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:29.311021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c16d792305e4fd39c10a5c5daedea2b', 'request_id': 'req-b770231b-3ee0-47f4-8b65-bfb5ae78204d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.321488 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2f4a87-4355-4d5b-aa87-5c3f8db1116e service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:29.324638 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c16d792305e4fd39c10a5c5daedea2b', 'request_id': 'req-b770231b-3ee0-47f4-8b65-bfb5ae78204d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.342876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c16d792305e4fd39c10a5c5daedea2b', 'request_id': 'req-b770231b-3ee0-47f4-8b65-bfb5ae78204d'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.357516 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] The token cache is being invalidate because project 1c16d792305e4fd39c10a5c5daedea2b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:29.358040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.359150 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.362004 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 918/1858] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:29 2022] DELETE /identity/v3/projects/1c16d792305e4fd39c10a5c5daedea2b => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:29.367505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:29.369790 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:29.405438 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:29.406248 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:29.406695 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:29.407049 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] PATH_INFO: `/v3/projects/3596ceaab3264a9188d542f040c40e0a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:29.408659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3596ceaab3264a9188d542f040c40e0a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:29.410887 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:29.464396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b770231b-3ee0-47f4-8b65-bfb5ae78204d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:29.477366 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3596ceaab3264a9188d542f040c40e0a', 'request_id': 'req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.484661 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3596ceaab3264a9188d542f040c40e0a', 'request_id': 'req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.499147 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3596ceaab3264a9188d542f040c40e0a', 'request_id': 'req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.513038 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] The token cache is being invalidate because project 3596ceaab3264a9188d542f040c40e0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:29.513352 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.514094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.518953 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 941/1859] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:29 2022] DELETE /identity/v3/projects/3596ceaab3264a9188d542f040c40e0a => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:29.525011 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:29.527296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:29.534880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:29.535388 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:29.535664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:29.535988 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] PATH_INFO: `/v3/users/01efb9ca14a849289d7dc28865e30076` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:29.537077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] RBAC: Authorizing `identity:delete_user(user_id=01efb9ca14a849289d7dc28865e30076)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:29.539050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:29.624664 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01efb9ca14a849289d7dc28865e30076'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.636427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:29.638626 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01efb9ca14a849289d7dc28865e30076'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.643755 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b127fb7-7cb8-4b12-8625-a4c88f5e59cd admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:29.651127 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01efb9ca14a849289d7dc28865e30076'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.655432 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:29.657204 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:29.657723 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:29.658163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] PATH_INFO: `/v3/users/05a1f71fe6b74c4590b4cf83c0d0f9f7` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:29.659448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05a1f71fe6b74c4590b4cf83c0d0f9f7)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:29.661491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:29.665566 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:29.666937 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01efb9ca14a849289d7dc28865e30076'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.667709 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01efb9ca14a849289d7dc28865e30076'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.677406 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 919/1860] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:29 2022] DELETE /identity/v3/users/01efb9ca14a849289d7dc28865e30076 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:29.735374 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05a1f71fe6b74c4590b4cf83c0d0f9f7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.742564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05a1f71fe6b74c4590b4cf83c0d0f9f7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.750725 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05a1f71fe6b74c4590b4cf83c0d0f9f7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.751521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05a1f71fe6b74c4590b4cf83c0d0f9f7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.764490 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05a1f71fe6b74c4590b4cf83c0d0f9f7'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:29.777808 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 942/1861] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:29 2022] DELETE /identity/v3/users/05a1f71fe6b74c4590b4cf83c0d0f9f7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:30.111525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.113163 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:30.139157 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.144921 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:30.239297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaf9d86-b439-4ecc-a753-04f63f80e80b admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.313497 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6c091-0a6e-401d-b8e1-8aa62ad6bd69 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.319200 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.319614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.320190 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.320309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.320467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.320572 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.320743 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] PATH_INFO: `/v3/projects/3942b2e44b604fcfa938e25bb3dc29f3` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.320847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] PATH_INFO: `/v3/projects/f8087b7e756541ea966ce5d561dd9fa5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.322176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8087b7e756541ea966ce5d561dd9fa5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.322291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3942b2e44b604fcfa938e25bb3dc29f3)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.324256 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.325119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.388006 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3942b2e44b604fcfa938e25bb3dc29f3', 'request_id': 'req-323e557a-6a23-46b4-a4b9-6434761420e6'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.393491 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3942b2e44b604fcfa938e25bb3dc29f3', 'request_id': 'req-323e557a-6a23-46b4-a4b9-6434761420e6'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.401974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8087b7e756541ea966ce5d561dd9fa5', 'request_id': 'req-31230617-9bd6-439f-836c-be54706ab8c6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.404529 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3942b2e44b604fcfa938e25bb3dc29f3', 'request_id': 'req-323e557a-6a23-46b4-a4b9-6434761420e6'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.410599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8087b7e756541ea966ce5d561dd9fa5', 'request_id': 'req-31230617-9bd6-439f-836c-be54706ab8c6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.422959 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] The token cache is being invalidate because project 3942b2e44b604fcfa938e25bb3dc29f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:30.423301 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.424113 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-323e557a-6a23-46b4-a4b9-6434761420e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.426343 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8087b7e756541ea966ce5d561dd9fa5', 'request_id': 'req-31230617-9bd6-439f-836c-be54706ab8c6'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.430512 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 920/1862] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:30 2022] DELETE /identity/v3/projects/3942b2e44b604fcfa938e25bb3dc29f3 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:30.431928 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f852c4-6c95-4d4c-9ea4-0ffe2776f119 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.432214 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f852c4-6c95-4d4c-9ea4-0ffe2776f119 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.432488 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f852c4-6c95-4d4c-9ea4-0ffe2776f119 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.441546 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] The token cache is being invalidate because project f8087b7e756541ea966ce5d561dd9fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:30.442835 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.443713 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-31230617-9bd6-439f-836c-be54706ab8c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:30.452293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 943/1863] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:30 2022] DELETE /identity/v3/projects/f8087b7e756541ea966ce5d561dd9fa5 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:30.457149 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd234-7a65-4159-9caa-db7158ad3274 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.457451 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd234-7a65-4159-9caa-db7158ad3274 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.457712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267bd234-7a65-4159-9caa-db7158ad3274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.458210 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e8f852c4-6c95-4d4c-9ea4-0ffe2776f119 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:30.459518 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e8f852c4-6c95-4d4c-9ea4-0ffe2776f119 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:30.493552 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:30.500257 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:30.516216 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-267bd234-7a65-4159-9caa-db7158ad3274 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:30.518609 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-267bd234-7a65-4159-9caa-db7158ad3274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:30.543363 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 921/1864] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:30.549927 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac48667-55d6-403c-9c7b-5f170611c2c1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.550505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac48667-55d6-403c-9c7b-5f170611c2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.550787 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac48667-55d6-403c-9c7b-5f170611c2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.584047 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-eac48667-55d6-403c-9c7b-5f170611c2c1 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:30.585660 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-eac48667-55d6-403c-9c7b-5f170611c2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:30.595205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 922/1865] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:30.599576 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac48667-55d6-403c-9c7b-5f170611c2c1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.604973 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 944/1866] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:30.615900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43be65-32ca-4458-af10-7dffcb1f4f2c None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.615900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43be65-32ca-4458-af10-7dffcb1f4f2c None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.615900 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43be65-32ca-4458-af10-7dffcb1f4f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.620818 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac48667-55d6-403c-9c7b-5f170611c2c1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.626758 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.627419 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.627721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.628027 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.628793 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:30.629279 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.630971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.633591 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-6e43be65-32ca-4458-af10-7dffcb1f4f2c None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:30.634847 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-6e43be65-32ca-4458-af10-7dffcb1f4f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:30.643035 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 945/1867] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:30.644077 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 923/1868] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:16:30.647163 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43be65-32ca-4458-af10-7dffcb1f4f2c None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.650240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.657427 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43be65-32ca-4458-af10-7dffcb1f4f2c None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.661652 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e335cd-75f4-40c9-a171-b965b17afb98 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.662664 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.663218 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.663502 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.663779 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.664466 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:30.664882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.666668 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.672258 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.673296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.673647 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.673978 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.675327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.677857 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.682939 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 946/1869] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:30.684022 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.695969 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86616-ae69-48ad-a071-c62ca7eb62e8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.701187 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.701840 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.702165 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.702472 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.703164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.705475 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.711932 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 924/1870] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/projects => generated 371 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:30.715964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.744039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 947/1871] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:30.745021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.789676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f247db63-5759-4c0e-87d9-4cf28cb2636d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.829447 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031455ec-476e-4175-b02b-b9a7d8a85385 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.835082 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.835822 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.836203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.836477 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.837443 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.839827 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.852725 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.853341 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.853734 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.854073 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.854693 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.856654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.868114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 948/1872] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/users => generated 287 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:30.869327 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.880957 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef97b96-8d1b-4f2b-8c06-1e87e4f0b416 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.883608 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 925/1873] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:30 2022] POST /identity/v3/users => generated 286 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:30.886467 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.887164 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.887525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.887623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.887912 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.888625 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.890319 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.897482 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8b1997-7554-45fb-93db-a08aab2f2809 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.901564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 949/1874] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:30.902421 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.903031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.903308 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.903585 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.904238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.905556 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.906220 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.917336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3549ce7c-7a48-4a8a-a720-ab177485b292 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.921470 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 926/1875] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:30.923198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.924674 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.925277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.925552 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.925817 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.926484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.928081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.933562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56470539-7eda-43c5-9c65-6a9a0636e2a1 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.938460 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.942133 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 950/1876] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:30.942291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.942291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.942291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.942291 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.942717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.943446 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.957198 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 927/1877] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:30.957356 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18bc16c3-434e-4ba7-88d7-505862c508e7 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.958530 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:30.958943 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19910059-c5b3-45f2-8a85-662209cffde4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.959582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910059-c5b3-45f2-8a85-662209cffde4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.959871 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910059-c5b3-45f2-8a85-662209cffde4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.960120 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19910059-c5b3-45f2-8a85-662209cffde4 admin admin] PATH_INFO: `/v3/projects/c5d3a74f2da340db9aeedfce556c677b/users/7cde30a6804d4b4b8d250558c96d5f55/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.967924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7a7db8-5099-4db7-88d7-35a50b685f3c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:30.973297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0628dbac-f173-4039-8d6b-bab0eb3e23bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:30.974176 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dbac-f173-4039-8d6b-bab0eb3e23bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:30.974449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dbac-f173-4039-8d6b-bab0eb3e23bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:30.974721 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0628dbac-f173-4039-8d6b-bab0eb3e23bf admin admin] PATH_INFO: `/v3/projects/d64a59fa03a643a297ad78391d8893cc/users/23e3542eafb847bab747207af26791c8/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:30.975389 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19910059-c5b3-45f2-8a85-662209cffde4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5d3a74f2da340db9aeedfce556c677b, user_id=7cde30a6804d4b4b8d250558c96d5f55, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.977101 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:30.978036 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19910059-c5b3-45f2-8a85-662209cffde4 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:30.992203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 951/1878] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:30 2022] PUT /identity/v3/projects/c5d3a74f2da340db9aeedfce556c677b/users/7cde30a6804d4b4b8d250558c96d5f55/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:30.992491 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628dbac-f173-4039-8d6b-bab0eb3e23bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=d64a59fa03a643a297ad78391d8893cc, user_id=23e3542eafb847bab747207af26791c8, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:30.995297 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0628dbac-f173-4039-8d6b-bab0eb3e23bf admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.003435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad971d-c15e-444b-8cea-64f1c9d8ceef None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.003715 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad971d-c15e-444b-8cea-64f1c9d8ceef None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.003986 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cad971d-c15e-444b-8cea-64f1c9d8ceef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.010072 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 928/1879] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:30 2022] PUT /identity/v3/projects/d64a59fa03a643a297ad78391d8893cc/users/23e3542eafb847bab747207af26791c8/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:31.025021 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:31.025773 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.026075 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.026409 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.035996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-9cad971d-c15e-444b-8cea-64f1c9d8ceef None None] MFA Rules not processed for user `7cde30a6804d4b4b8d250558c96d5f55`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:31.037263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-9cad971d-c15e-444b-8cea-64f1c9d8ceef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:31.060663 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] MFA Rules not processed for user `23e3542eafb847bab747207af26791c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:31.062515 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:31.126786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 952/1880] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:31.134140 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad971d-c15e-444b-8cea-64f1c9d8ceef None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.157234 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 929/1881] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:31.167880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.169540 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:31.209504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cad971d-c15e-444b-8cea-64f1c9d8ceef None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.215252 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.216083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.216468 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.216811 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.217542 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.221501 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.270430 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 953/1882] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:31 2022] POST /identity/v3/projects => generated 373 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:31.274983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.294471 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a5f81d-7f4f-4beb-94d5-e65e16a88108 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.359048 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.359997 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.361626 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.362074 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.374391 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85258e7d-2d4e-4856-bb68-0002153ec8ed admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.391296 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.392104 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.392482 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.393005 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.393712 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.395805 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.431974 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 954/1883] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:31 2022] POST /identity/v3/users => generated 293 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:31.436081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.448184 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56695e-d2bf-4116-9392-1d2ede3b0166 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.455582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.456419 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.456995 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.457309 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.457991 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.459933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.471349 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:31.471954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 955/1884] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:31.478025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.489519 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:31.495465 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7388632-2305-4640-be6e-01147c934c11 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.499806 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.502039 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.504814 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.505775 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.506180 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.506526 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] PATH_INFO: `/v3/projects/1e9eb7a7df914e56bb4fc26547bac973/users/d4f77558c39e439bae31a75f32faaa7f/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.515865 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 930/1885] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:31 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:31.538083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9eb7a7df914e56bb4fc26547bac973, user_id=d4f77558c39e439bae31a75f32faaa7f, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.538083 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.541227 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.550087 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 956/1886] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:31 2022] PUT /identity/v3/projects/1e9eb7a7df914e56bb4fc26547bac973/users/d4f77558c39e439bae31a75f32faaa7f/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:31.555456 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.557907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebeb65-acfe-488d-bced-340b70b42d84 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.649373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.650353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.651353 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.651960 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] PATH_INFO: `/v3/users/23e3542eafb847bab747207af26791c8` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.653605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23e3542eafb847bab747207af26791c8)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.659212 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.719639 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0015ba27-8fba-4080-8222-e04d9a5c25e5 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.727948 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.728802 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.729211 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.729561 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.730354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.732537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.748771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 957/1887] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:31 2022] GET /identity/v3/roles => generated 1420 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:31.758232 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.778011 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23e3542eafb847bab747207af26791c8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:31.780270 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cda1668-5129-4701-bf26-74e1d6dcfff0 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:31.787511 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ac40ca-ff05-4519-a129-57c765029571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:31.788286 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac40ca-ff05-4519-a129-57c765029571 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.788582 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac40ca-ff05-4519-a129-57c765029571 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.788853 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ac40ca-ff05-4519-a129-57c765029571 admin admin] PATH_INFO: `/v3/projects/1e9eb7a7df914e56bb4fc26547bac973/users/d4f77558c39e439bae31a75f32faaa7f/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.790262 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23e3542eafb847bab747207af26791c8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:31.791254 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac40ca-ff05-4519-a129-57c765029571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e9eb7a7df914e56bb4fc26547bac973, user_id=d4f77558c39e439bae31a75f32faaa7f, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:31.793919 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ac40ca-ff05-4519-a129-57c765029571 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:31.799816 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23e3542eafb847bab747207af26791c8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:31.805907 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 958/1888] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:31 2022] PUT /identity/v3/projects/1e9eb7a7df914e56bb4fc26547bac973/users/d4f77558c39e439bae31a75f32faaa7f/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:31.812912 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23e3542eafb847bab747207af26791c8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:31.813826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-24acb823-fd89-4c0a-946f-75e6edcd3df3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23e3542eafb847bab747207af26791c8'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:31.818787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.818954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.819227 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.822139 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 931/1889] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:31 2022] DELETE /identity/v3/users/23e3542eafb847bab747207af26791c8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:31.825562 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:31.825911 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:31.826306 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:31.851625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:31.852907 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:31.858848 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] MFA Rules not processed for user `d4f77558c39e439bae31a75f32faaa7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:31.860230 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:31.932955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 932/1890] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:31.933977 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.935373 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:31.941494 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:31.969992 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 959/1891] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:31 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:31.975425 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:31.979203 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.012340 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8464373-ceeb-45bf-80c8-44776152a1ea None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:32.016080 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:32.016710 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.017180 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.017465 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.019294 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.044849 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:32.054733 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbe14d2-6c18-4540-ba5b-c88c2a6716fc None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:32.062816 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:32.063562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.063709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.063977 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.075075 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:32.076521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:32.085658 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:32.087452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:32.088774 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 960/1892] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:32.089723 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:32.091159 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.097367 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 933/1893] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:32.104321 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56da0567-12bc-4fe5-8fa4-f5b97a174d23 service neutron] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:32.108700 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:32.109448 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.109870 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.110399 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.122709 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:32.124177 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:32.146749 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 961/1894] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:32.303535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:32.305158 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.310965 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:32.319477 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce98308-df03-48a0-947b-7751e55a921d service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:32.321544 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e62b97-62a0-4680-bae5-7dc34e354de0 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:32.324446 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:32.325088 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.325365 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.325635 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] PATH_INFO: `/v3/users/c5caed553b754775adeec3292e9e30af` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.326237 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:32.326873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5caed553b754775adeec3292e9e30af)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:32.327039 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.327410 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.327896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.329066 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:32.330462 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.398856 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:32.400365 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:32.406142 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5caed553b754775adeec3292e9e30af'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.411537 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 962/1895] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:32.420922 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5caed553b754775adeec3292e9e30af'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.445128 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5caed553b754775adeec3292e9e30af'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.467676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:32.469760 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.477888 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5caed553b754775adeec3292e9e30af'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.478824 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-f127dee9-3ce8-4c6a-a3fc-8a3c985c4694 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5caed553b754775adeec3292e9e30af'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.494391 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 934/1896] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:32 2022] DELETE /identity/v3/users/c5caed553b754775adeec3292e9e30af => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:32.494530 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0009c12c-b2ad-487e-b4a5-1d36cd7ee708 service cinder] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:32.496860 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.497391 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.497826 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.523918 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:32.526948 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.563939 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:32.614767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 935/1897] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:32.631316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:32.634193 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.655532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:32.656213 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.656743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.656743 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] PATH_INFO: `/v3/projects/d64a59fa03a643a297ad78391d8893cc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.659128 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] RBAC: Authorizing `identity:delete_project(project_id=d64a59fa03a643a297ad78391d8893cc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:32.666697 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:32.713809 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee54a2f9-cec9-4354-8be1-ca6d46d5b2b1 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:32.719397 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2619e-19fd-4fda-b692-2ce3d79cf1fb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:32.720204 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2619e-19fd-4fda-b692-2ce3d79cf1fb service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.720728 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2619e-19fd-4fda-b692-2ce3d79cf1fb service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.721513 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2619e-19fd-4fda-b692-2ce3d79cf1fb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.740662 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2619e-19fd-4fda-b692-2ce3d79cf1fb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:32.742452 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c2619e-19fd-4fda-b692-2ce3d79cf1fb service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:32.748692 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd64a59fa03a643a297ad78391d8893cc', 'request_id': 'req-0f63a1d2-3db8-4920-ade1-a0728aa85cca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.762144 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd64a59fa03a643a297ad78391d8893cc', 'request_id': 'req-0f63a1d2-3db8-4920-ade1-a0728aa85cca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.767668 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 936/1898] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:32.781172 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd64a59fa03a643a297ad78391d8893cc', 'request_id': 'req-0f63a1d2-3db8-4920-ade1-a0728aa85cca'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.803630 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] The token cache is being invalidate because project d64a59fa03a643a297ad78391d8893cc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:32.804007 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.804892 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-0f63a1d2-3db8-4920-ade1-a0728aa85cca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:32.807277 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 963/1899] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:32 2022] DELETE /identity/v3/projects/d64a59fa03a643a297ad78391d8893cc => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:32.813396 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d90a9-72e3-450c-9fc9-1c65d03125a6 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.813965 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d90a9-72e3-450c-9fc9-1c65d03125a6 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.814327 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87d90a9-72e3-450c-9fc9-1c65d03125a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.882296 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d87d90a9-72e3-450c-9fc9-1c65d03125a6 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:32.883505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d87d90a9-72e3-450c-9fc9-1c65d03125a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:32.976095 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 937/1900] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:32.985464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639609dd-3eb5-4a6f-8e93-18247124e693 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:32.986081 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639609dd-3eb5-4a6f-8e93-18247124e693 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:32.986269 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639609dd-3eb5-4a6f-8e93-18247124e693 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:32.995532 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:33.013043 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-639609dd-3eb5-4a6f-8e93-18247124e693 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:33.014615 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-639609dd-3eb5-4a6f-8e93-18247124e693 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:33.031233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d90a9-72e3-450c-9fc9-1c65d03125a6 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.031484 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 964/1901] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:33.050550 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87d90a9-72e3-450c-9fc9-1c65d03125a6 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.056403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.057338 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.057623 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.057898 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.058719 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:33.059031 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.060644 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.082368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 938/1902] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:33.083676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639609dd-3eb5-4a6f-8e93-18247124e693 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.098111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639609dd-3eb5-4a6f-8e93-18247124e693 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.100123 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.100740 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.101018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.101562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.102000 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.104025 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.161780 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 965/1903] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:33 2022] POST /identity/v3/projects => generated 383 bytes in 79 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:33.165812 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.183425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57da9400-c20c-4034-aebf-614c52d93c6a admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.230807 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.232663 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:33.314889 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.316191 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.316974 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.322041 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.322835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.324964 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.340505 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:33.356932 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f685b-2edc-46a4-9498-2ec3fa322554 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.378122 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 939/1904] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:33 2022] POST /identity/v3/users => generated 292 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:33.378346 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.379111 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.379496 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.379843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] PATH_INFO: `/v3/projects/94eccd5eca6b46a4b44fa7dd95e1ba66` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.381564 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] RBAC: Authorizing `identity:delete_project(project_id=94eccd5eca6b46a4b44fa7dd95e1ba66)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.382732 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.383951 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.396731 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcb8128e-5073-42bd-9b2b-4368722d5904 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.402483 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.403442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.404050 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.404586 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.405502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.407955 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.422099 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 940/1905] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:33.427009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.440240 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939875cf-4c48-4e4f-ae00-6dacbdbe1c07 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.456933 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '94eccd5eca6b46a4b44fa7dd95e1ba66', 'request_id': 'req-8bd90875-2b6c-41ec-b491-48c8229ce77b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.465826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '94eccd5eca6b46a4b44fa7dd95e1ba66', 'request_id': 'req-8bd90875-2b6c-41ec-b491-48c8229ce77b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.486229 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '94eccd5eca6b46a4b44fa7dd95e1ba66', 'request_id': 'req-8bd90875-2b6c-41ec-b491-48c8229ce77b'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.507006 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] The token cache is being invalidate because project 94eccd5eca6b46a4b44fa7dd95e1ba66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:33.507491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.509055 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.510801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 966/1906] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:33 2022] DELETE /identity/v3/projects/94eccd5eca6b46a4b44fa7dd95e1ba66 => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:33.514896 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.515892 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.517476 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.517767 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.518043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.518215 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:33.518779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.520763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.533500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 941/1907] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 08 01:16:33.538498 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.540507 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd90875-2b6c-41ec-b491-48c8229ce77b admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.540637 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:33.548782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.549602 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.550503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.551019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] PATH_INFO: `/v3/users/10be286066c846639cdcbb639f9659dc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.553394 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] RBAC: Authorizing `identity:delete_user(user_id=10be286066c846639cdcbb639f9659dc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.557711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.559241 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8c8208-1486-4700-a75d-3f566e641db0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.566431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4398bb69-55b0-4a75-a711-c8a844da9912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.567524 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398bb69-55b0-4a75-a711-c8a844da9912 admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.568023 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398bb69-55b0-4a75-a711-c8a844da9912 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.568246 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4398bb69-55b0-4a75-a711-c8a844da9912 admin admin] PATH_INFO: `/v3/projects/cc84f166f80f4c4e99f737a4ffd3b64f/users/343e4276a85e438b898e01906806d6a2/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.588753 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398bb69-55b0-4a75-a711-c8a844da9912 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc84f166f80f4c4e99f737a4ffd3b64f, user_id=343e4276a85e438b898e01906806d6a2, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.591727 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4398bb69-55b0-4a75-a711-c8a844da9912 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.613469 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 942/1908] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:33 2022] PUT /identity/v3/projects/cc84f166f80f4c4e99f737a4ffd3b64f/users/343e4276a85e438b898e01906806d6a2/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:33.622897 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10be286066c846639cdcbb639f9659dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.624261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.624621 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.624992 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.631381 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10be286066c846639cdcbb639f9659dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.635013 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=82,keystone:INSERT=3,keystone:DELETE=15 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:33.640660 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10be286066c846639cdcbb639f9659dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.642614 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10be286066c846639cdcbb639f9659dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.657454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] MFA Rules not processed for user `343e4276a85e438b898e01906806d6a2`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:33.659319 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:33.672068 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10be286066c846639cdcbb639f9659dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:33.690019 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 967/1909] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:33 2022] DELETE /identity/v3/users/10be286066c846639cdcbb639f9659dc => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:33.766089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 943/1910] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:33.777956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:33.780464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:33.859758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16db64e-01c9-4130-b3c2-f5292100357d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:33.863883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b50051-da66-4dc4-b343-22d236b85a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:33.865539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b50051-da66-4dc4-b343-22d236b85a8f service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:33.865929 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b50051-da66-4dc4-b343-22d236b85a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:33.866334 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b50051-da66-4dc4-b343-22d236b85a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:33.946788 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b50051-da66-4dc4-b343-22d236b85a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:33.949622 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b50051-da66-4dc4-b343-22d236b85a8f service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:33.969576 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 968/1911] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:34.220993 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:34.222655 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:34.329659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:34.368231 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b3da2-eb42-424b-ace6-bfa5101b074b None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:34.467991 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:34.468813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.469105 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.470288 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] PATH_INFO: `/v3/projects/dc600acaae9a4d679cf6d304f9afc4f6` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.471737 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc600acaae9a4d679cf6d304f9afc4f6)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:34.474040 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:34.527605 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc600acaae9a4d679cf6d304f9afc4f6', 'request_id': 'req-cfcacf93-ce4f-488e-b351-980a38f3ee64'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:34.535154 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc600acaae9a4d679cf6d304f9afc4f6', 'request_id': 'req-cfcacf93-ce4f-488e-b351-980a38f3ee64'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:34.546418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc600acaae9a4d679cf6d304f9afc4f6', 'request_id': 'req-cfcacf93-ce4f-488e-b351-980a38f3ee64'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:34.560298 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] The token cache is being invalidate because project dc600acaae9a4d679cf6d304f9afc4f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80318) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:34.560684 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:34.561418 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-cfcacf93-ce4f-488e-b351-980a38f3ee64 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:34.566535 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 944/1912] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:34 2022] DELETE /identity/v3/projects/dc600acaae9a4d679cf6d304f9afc4f6 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:34.570524 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8f44-0ae7-44d8-a617-97d0ad9088cd None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.572124 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8f44-0ae7-44d8-a617-97d0ad9088cd None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.572895 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aae8f44-0ae7-44d8-a617-97d0ad9088cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.597799 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-2aae8f44-0ae7-44d8-a617-97d0ad9088cd None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:34.599317 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2aae8f44-0ae7-44d8-a617-97d0ad9088cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:34.669905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 969/1913] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:34.679825 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336bc0-0025-4a25-a2a2-29b568c2b121 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.680705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336bc0-0025-4a25-a2a2-29b568c2b121 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.681081 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa336bc0-0025-4a25-a2a2-29b568c2b121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.710880 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-aa336bc0-0025-4a25-a2a2-29b568c2b121 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:34.712123 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-aa336bc0-0025-4a25-a2a2-29b568c2b121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:34.721874 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 945/1914] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:34.725927 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8f44-0ae7-44d8-a617-97d0ad9088cd None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:34.736169 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aae8f44-0ae7-44d8-a617-97d0ad9088cd None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:34.741379 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:34.742093 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.742418 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.742771 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] PATH_INFO: `/v3/domains` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.743491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80319) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:34.743843 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:34.745776 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:34.763863 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 970/1915] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 08 01:16:34.765502 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336bc0-0025-4a25-a2a2-29b568c2b121 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:34.777124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa336bc0-0025-4a25-a2a2-29b568c2b121 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:34.791924 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d0e8d0-ad4c-40ee-8949-04956cfed70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:34.792838 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e8d0-ad4c-40ee-8949-04956cfed70f admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.793233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e8d0-ad4c-40ee-8949-04956cfed70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.793529 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d0e8d0-ad4c-40ee-8949-04956cfed70f admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.794335 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0e8d0-ad4c-40ee-8949-04956cfed70f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:34.796449 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d0e8d0-ad4c-40ee-8949-04956cfed70f admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:34.834009 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 946/1916] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:34 2022] POST /identity/v3/projects => generated 393 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:34.839069 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:34.851453 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dc989-f98a-4211-b2b0-5f05250ab238 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:34.863667 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ea6ae-abbe-4ad7-910b-5bc41d55a83a None None] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.864042 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ea6ae-abbe-4ad7-910b-5bc41d55a83a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.864467 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378ea6ae-abbe-4ad7-910b-5bc41d55a83a None None] PATH_INFO: `/` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.866038 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 947/1917] 10.222.0.39 () {54 vars in 921 bytes} [Mon Aug 8 01:16:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 08 01:16:34.875993 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:34.886196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af9a8-6d0a-4260-97ad-2794ee3b8531 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.886196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af9a8-6d0a-4260-97ad-2794ee3b8531 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.886196 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9af9a8-6d0a-4260-97ad-2794ee3b8531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.907632 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-0f9af9a8-6d0a-4260-97ad-2794ee3b8531 None None] MFA Rules not processed for user `4a0d809789674bdeaa6763ee4151ca86`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:34.908931 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-0f9af9a8-6d0a-4260-97ad-2794ee3b8531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:34.946966 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:34.947621 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:34.947901 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:34.948258 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:34.948960 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:34.951174 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:34.976098 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 971/1918] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:34 2022] POST /identity/v3/users => generated 297 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:34.976837 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:34.984012 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:34.989454 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:34.999745 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b9d62b-8bf1-43b0-8709-a66005459598 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.005042 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.005741 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.006035 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.006387 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] PATH_INFO: `/v3/users/52e563eb752a4b70a115909a9719c8dc` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.007659 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=52e563eb752a4b70a115909a9719c8dc)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.009613 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.019089 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 948/1919] 10.222.0.39 () {58 vars in 1018 bytes} [Mon Aug 8 01:16:34 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:35.019963 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9af9a8-6d0a-4260-97ad-2794ee3b8531 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.030748 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9af9a8-6d0a-4260-97ad-2794ee3b8531 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.036706 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.037344 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.037625 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.037921 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.038803 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.040705 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.052573 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 949/1920] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:35.053487 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.055228 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:35.063938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52e563eb752a4b70a115909a9719c8dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:35.070453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b0d100-0b56-411f-85d0-8527fa6602b7 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.071522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52e563eb752a4b70a115909a9719c8dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:35.080742 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a82ca1-6f79-4283-b286-89c193d8c04d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4a0d809789674bdeaa6763ee4151ca86', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service', 'reader', 'ResellerAdmin', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.081394 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82ca1-6f79-4283-b286-89c193d8c04d service nova] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.081671 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82ca1-6f79-4283-b286-89c193d8c04d service nova] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.081973 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a82ca1-6f79-4283-b286-89c193d8c04d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.083208 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52e563eb752a4b70a115909a9719c8dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:35.083922 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52e563eb752a4b70a115909a9719c8dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:35.091448 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82ca1-6f79-4283-b286-89c193d8c04d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.093146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a82ca1-6f79-4283-b286-89c193d8c04d service nova] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.096673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52e563eb752a4b70a115909a9719c8dc'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:35.102844 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 972/1921] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:34 2022] DELETE /identity/v3/users/52e563eb752a4b70a115909a9719c8dc => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:35.103758 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.104197 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 950/1922] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:35.106925 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:35.115765 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.116244 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.116520 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.136280 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:35.137500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:35.195675 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b23886e-a745-491c-bd78-a8ec283fdd5d admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.200897 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.201557 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.201772 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.202045 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.202784 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.204711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.206093 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 951/1923] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:35.215472 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.215882 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 973/1924] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:35.219759 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.221401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:35.231603 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec037de6-ef0e-47fd-a546-b86e5443a8a3 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.237694 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e45e37-1bcd-4f49-9cb0-fd10282df271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.238428 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e45e37-1bcd-4f49-9cb0-fd10282df271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.238711 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e45e37-1bcd-4f49-9cb0-fd10282df271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.238983 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e45e37-1bcd-4f49-9cb0-fd10282df271 admin admin] PATH_INFO: `/v3/projects/dc1952c20c324258b47caa10334c176c/users/c7a88bee92a242749cbd87f96f25fff3/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.258294 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e45e37-1bcd-4f49-9cb0-fd10282df271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1952c20c324258b47caa10334c176c, user_id=c7a88bee92a242749cbd87f96f25fff3, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.263070 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e45e37-1bcd-4f49-9cb0-fd10282df271 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.265794 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:35.286971 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 974/1925] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:35 2022] PUT /identity/v3/projects/dc1952c20c324258b47caa10334c176c/users/c7a88bee92a242749cbd87f96f25fff3/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:35.298292 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e218502a-84f6-4949-aeff-4143f38f391e None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.299304 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f982-bc84-4804-9854-9ecdc0acc03b None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.299691 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f982-bc84-4804-9854-9ecdc0acc03b None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.300166 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e4f982-bc84-4804-9854-9ecdc0acc03b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.334698 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-b7e4f982-bc84-4804-9854-9ecdc0acc03b None None] MFA Rules not processed for user `c7a88bee92a242749cbd87f96f25fff3`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:35.335996 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-b7e4f982-bc84-4804-9854-9ecdc0acc03b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:35.373555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4af463e787364ed680b453d027c81f72', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.373555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.373555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.373555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.402980 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:35.445561 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.447261 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.472501 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 952/1926] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:35.476360 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 975/1927] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:35.480403 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.492272 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4202e365-0908-442c-8579-e9225ca2aee1 service neutron] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.497431 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.498220 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.498763 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.498934 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] PATH_INFO: `/v3/projects` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.499873 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.502266 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.549703 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 953/1928] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:35 2022] POST /identity/v3/projects => generated 393 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:35.550518 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f982-bc84-4804-9854-9ecdc0acc03b None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.562787 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e4f982-bc84-4804-9854-9ecdc0acc03b None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.633523 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.638271 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.638688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.639071 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] PATH_INFO: `/v3/users` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.639852 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.642119 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.679307 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 976/1929] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:35 2022] POST /identity/v3/users => generated 303 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:35.686140 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.703802 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac7002e-12c3-419b-b952-9eb9cfbe15be admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.715999 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.717124 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.717619 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.718919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.719782 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.722582 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.751555 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 954/1930] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:35.756318 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.770332 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc8263-002f-427a-9f66-ee06726a9cea admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.775610 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.776386 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.777336 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.777569 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] PATH_INFO: `/v3/projects/8efa0b649e8c4fd4b0311959c045e163/users/03bb1d99107e4c8b86d94f81f86ff7c0/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.845672 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efa0b649e8c4fd4b0311959c045e163, user_id=03bb1d99107e4c8b86d94f81f86ff7c0, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.848599 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.868424 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 977/1931] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:35 2022] PUT /identity/v3/projects/8efa0b649e8c4fd4b0311959c045e163/users/03bb1d99107e4c8b86d94f81f86ff7c0/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:35.872188 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.883225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3e0758-2742-406b-9929-55d99a4f981c admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.952291 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.953792 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:35.965914 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.966730 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.966919 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.967211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.967876 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.969521 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2504ddf2-5f54-44a9-8a76-47619bc5e180 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:35.969641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.975114 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:35.976154 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:35.976534 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:35.976956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] PATH_INFO: `/v3/projects/516f4c43dee3439b8a6c85bbac3015be` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:35.978464 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=516f4c43dee3439b8a6c85bbac3015be)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:35.981956 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:35.985670 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 955/1932] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:35 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:35.987092 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:35.997525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d229f-f274-49d3-8bc8-aaa80466057d admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:36.002433 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f5bcfe-81c1-42ac-8262-dce168aaf72b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:36.003100 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5bcfe-81c1-42ac-8262-dce168aaf72b admin admin] REQUEST_METHOD: `PUT` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:36.003381 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5bcfe-81c1-42ac-8262-dce168aaf72b admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:36.003654 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f5bcfe-81c1-42ac-8262-dce168aaf72b admin admin] PATH_INFO: `/v3/projects/8efa0b649e8c4fd4b0311959c045e163/users/03bb1d99107e4c8b86d94f81f86ff7c0/roles/c1d69d4e205e4dd2a70bde18f8382f38` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:36.005856 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5bcfe-81c1-42ac-8262-dce168aaf72b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8efa0b649e8c4fd4b0311959c045e163, user_id=03bb1d99107e4c8b86d94f81f86ff7c0, role_id=c1d69d4e205e4dd2a70bde18f8382f38)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:36.010920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f5bcfe-81c1-42ac-8262-dce168aaf72b admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:36.030315 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 956/1933] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:35 2022] PUT /identity/v3/projects/8efa0b649e8c4fd4b0311959c045e163/users/03bb1d99107e4c8b86d94f81f86ff7c0/roles/c1d69d4e205e4dd2a70bde18f8382f38 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:36.035376 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:36.035717 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:36.036001 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:36.040522 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:INSERT=5,keystone:SELECT=92,keystone:DELETE=3 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:36.044958 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '516f4c43dee3439b8a6c85bbac3015be', 'request_id': 'req-865ea13b-721a-4e07-a7ba-d3f50b86b516'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.052613 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '516f4c43dee3439b8a6c85bbac3015be', 'request_id': 'req-865ea13b-721a-4e07-a7ba-d3f50b86b516'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.062265 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '516f4c43dee3439b8a6c85bbac3015be', 'request_id': 'req-865ea13b-721a-4e07-a7ba-d3f50b86b516'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.064949 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] MFA Rules not processed for user `03bb1d99107e4c8b86d94f81f86ff7c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:36.066211 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:36.074018 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] The token cache is being invalidate because project 516f4c43dee3439b8a6c85bbac3015be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:36.074344 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.075153 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.079938 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 978/1934] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:35 2022] DELETE /identity/v3/projects/516f4c43dee3439b8a6c85bbac3015be => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:36.081026 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:36.082649 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:36.137695 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:36.144282 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 957/1935] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:36 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:36.150503 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865ea13b-721a-4e07-a7ba-d3f50b86b516 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:36.155158 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:36.155789 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:36.156094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:36.156238 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:36.156411 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] PATH_INFO: `/v3/users/8fb40ee4fe494513ae965969138ff31d` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:36.157669 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8fb40ee4fe494513ae965969138ff31d)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:36.157776 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:36.159627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:36.209671 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8fb40ee4fe494513ae965969138ff31d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.214779 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84c2d3e-0fc0-44e6-8a0f-38f2da4c6255 None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:36.216854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8fb40ee4fe494513ae965969138ff31d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.218337 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:36.219062 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:36.219360 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:36.219595 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:36.225782 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8fb40ee4fe494513ae965969138ff31d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.226525 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8fb40ee4fe494513ae965969138ff31d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.229020 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:36.230519 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:36.239535 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8fb40ee4fe494513ae965969138ff31d'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.240468 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 958/1936] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 08 01:16:36.247573 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 979/1937] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:36 2022] DELETE /identity/v3/users/8fb40ee4fe494513ae965969138ff31d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:36.289797 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:36.291332 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:36.304499 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ecc51d-4969-4463-8497-75b36faf8030 service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:36.356213 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:36.356835 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:36.357114 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:36.357385 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:36.359225 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:36.431033 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:36.433442 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:36.447466 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 959/1938] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:36 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:36.722030 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:36.723504 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:36.847094 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:36.868917 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce721a50-566c-4b6b-b46a-24b55c71b72f admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:36.885156 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:36.887295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:36.887295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:36.887295 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] PATH_INFO: `/v3/projects/86bad712c13a4295b72f42d2f62e960a` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:36.888324 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=86bad712c13a4295b72f42d2f62e960a)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:36.890914 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:36.950445 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86bad712c13a4295b72f42d2f62e960a', 'request_id': 'req-2b441300-752e-487e-bc8d-c507af2e74cf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.955905 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86bad712c13a4295b72f42d2f62e960a', 'request_id': 'req-2b441300-752e-487e-bc8d-c507af2e74cf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.965136 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86bad712c13a4295b72f42d2f62e960a', 'request_id': 'req-2b441300-752e-487e-bc8d-c507af2e74cf'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.978676 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] The token cache is being invalidate because project 86bad712c13a4295b72f42d2f62e960a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:36.978885 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.979539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:36.981441 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 980/1939] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:36 2022] DELETE /identity/v3/projects/86bad712c13a4295b72f42d2f62e960a => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:36.985618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:36.996368 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a2192-3c29-40f2-8682-7c78b3870bea service cinder] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:37.052035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=100 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:37.059390 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:37.060036 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.060316 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.060589 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] PATH_INFO: `/v3/users/32c7a8bd26a3428482d1a3c13a1299d5` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.061751 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] RBAC: Authorizing `identity:delete_user(user_id=32c7a8bd26a3428482d1a3c13a1299d5)` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:37.064148 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:37.133242 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32c7a8bd26a3428482d1a3c13a1299d5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.142021 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32c7a8bd26a3428482d1a3c13a1299d5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.149371 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32c7a8bd26a3428482d1a3c13a1299d5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.163425 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32c7a8bd26a3428482d1a3c13a1299d5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.164146 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.notifications [None req-af60c58f-78c8-4b57-8d3e-9ba0cb9378be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32c7a8bd26a3428482d1a3c13a1299d5'} {{(pid=80318) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.170018 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 960/1940] 10.222.0.39 () {58 vars in 1224 bytes} [Mon Aug 8 01:16:36 2022] DELETE /identity/v3/users/32c7a8bd26a3428482d1a3c13a1299d5 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 08 01:16:37.450160 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:37.451801 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:37.466261 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b441300-752e-487e-bc8d-c507af2e74cf admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:37.526099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:37.526647 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.526911 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.527186 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] PATH_INFO: `/v3/projects/d293ffc3cc244ee29b4dfaf5d8b44aa6` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.528341 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] RBAC: Authorizing `identity:delete_project(project_id=d293ffc3cc244ee29b4dfaf5d8b44aa6)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:37.530391 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:37.592750 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd293ffc3cc244ee29b4dfaf5d8b44aa6', 'request_id': 'req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.598746 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd293ffc3cc244ee29b4dfaf5d8b44aa6', 'request_id': 'req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.607854 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd293ffc3cc244ee29b4dfaf5d8b44aa6', 'request_id': 'req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb'} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.618904 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] The token cache is being invalidate because project d293ffc3cc244ee29b4dfaf5d8b44aa6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80319) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 08 01:16:37.619195 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.619815 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.notifications [None req-7d8623ce-f9c7-4a40-8fe4-79b820a80bcb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80319) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 08 01:16:37.621284 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 981/1941] 10.222.0.39 () {58 vars in 1233 bytes} [Mon Aug 8 01:16:37 2022] DELETE /identity/v3/projects/d293ffc3cc244ee29b4dfaf5d8b44aa6 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:37.627525 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3107591-dade-403b-8a23-41d6e559822f None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.628049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3107591-dade-403b-8a23-41d6e559822f None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.628049 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3107591-dade-403b-8a23-41d6e559822f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.648920 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-d3107591-dade-403b-8a23-41d6e559822f None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:37.650166 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-d3107591-dade-403b-8a23-41d6e559822f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:37.714590 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 961/1942] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 08 01:16:37.724099 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24900c9-97bf-4f8f-bb1b-b8e186292341 None None] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.724601 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24900c9-97bf-4f8f-bb1b-b8e186292341 None None] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.724772 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24900c9-97bf-4f8f-bb1b-b8e186292341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.744638 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.auth.core [None req-e24900c9-97bf-4f8f-bb1b-b8e186292341 None None] MFA Rules not processed for user `cee3be3b33524c19a70d02b4d0135141`. Rule list: `[]` (Enabled: `True`). {{(pid=80319) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:37.745959 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-e24900c9-97bf-4f8f-bb1b-b8e186292341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:37.754560 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 982/1943] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:37.758915 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3107591-dade-403b-8a23-41d6e559822f None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:37.769035 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3107591-dade-403b-8a23-41d6e559822f None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:37.774628 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:37.775791 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.776500 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.776777 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] PATH_INFO: `/v3/domains` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.777774 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80318) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 08 01:16:37.777926 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:37.779676 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:37.793119 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 962/1944] 10.222.0.39 () {58 vars in 1153 bytes} [Mon Aug 8 01:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 08 01:16:37.797786 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24900c9-97bf-4f8f-bb1b-b8e186292341 None None] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:37.806004 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:37.810435 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24900c9-97bf-4f8f-bb1b-b8e186292341 None None] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:37.817278 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:37.817963 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.818673 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.818954 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.819883 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:37.822108 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:37.853079 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 983/1945] 10.222.0.39 () {60 vars in 1153 bytes} [Mon Aug 8 01:16:37 2022] POST /identity/v3/projects => generated 377 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 08 01:16:37.860034 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:37.870453 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f3146c-d371-4e6d-8249-a7f74ee10a96 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:37.939086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:37.939086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.939086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.939086 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] PATH_INFO: `/v3/users` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.939401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:37.939401 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:37.947493 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:37.967569 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 963/1946] 10.222.0.39 () {60 vars in 1144 bytes} [Mon Aug 8 01:16:37 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 08 01:16:37.968913 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:37.979688 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53c3c39-ca6d-43cd-b421-24c62fe355b2 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:37.984493 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:37.985098 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:37.985362 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:37.985627 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:37.986363 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:37.988233 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:37.998293 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 984/1947] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:38.002659 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:38.013380 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8851620-5ceb-4296-868d-532ddf9133f0 admin admin] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:38.019160 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a632f-7998-41a2-8f89-bec8dd431ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:38.019762 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a632f-7998-41a2-8f89-bec8dd431ea6 admin admin] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:38.020043 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a632f-7998-41a2-8f89-bec8dd431ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:38.020310 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a632f-7998-41a2-8f89-bec8dd431ea6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:38.020962 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a632f-7998-41a2-8f89-bec8dd431ea6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:38.022641 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130a632f-7998-41a2-8f89-bec8dd431ea6 admin admin] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:38.034831 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 964/1948] 10.222.0.39 () {58 vars in 1122 bytes} [Mon Aug 8 01:16:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 08 01:16:38.039014 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:38.049648 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed0ea01-b77c-4a67-9018-c027611c81cb admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:38.054657 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cee3be3b33524c19a70d02b4d0135141', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1076d8c1402c4204a0e2862514393b33', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:38.055285 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:38.055562 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:38.055826 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] PATH_INFO: `/v3/projects/5a0419633d7746cfbc536c3245b5168a/users/af28294a7f004a2698d8a1538244ebd3/roles/ec37613f9e804c21b03ddafcb4c445f5` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:38.071354 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0419633d7746cfbc536c3245b5168a, user_id=af28294a7f004a2698d8a1538244ebd3, role_id=ec37613f9e804c21b03ddafcb4c445f5)` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:38.073988 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:38.090491 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 985/1949] 10.222.0.39 () {60 vars in 1483 bytes} [Mon Aug 8 01:16:38 2022] PUT /identity/v3/projects/5a0419633d7746cfbc536c3245b5168a/users/af28294a7f004a2698d8a1538244ebd3/roles/ec37613f9e804c21b03ddafcb4c445f5 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 08 01:16:38.101813 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] REQUEST_METHOD: `POST` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:38.102205 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:38.102490 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:38.134833 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.auth.core [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] MFA Rules not processed for user `af28294a7f004a2698d8a1538244ebd3`. Rule list: `[]` (Enabled: `True`). {{(pid=80318) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 08 01:16:38.136380 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:38.206971 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 965/1950] 10.222.0.39 () {58 vars in 958 bytes} [Mon Aug 8 01:16:38 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 08 01:16:38.220263 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] Authenticating user token {{(pid=80319) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:16:38.222176 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.fernet_utils [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80319) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:16:38.289539 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26eb963c-58c7-433d-9ae5-fb5626af59d8 admin admin] Validating token access rules against request {{(pid=80319) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:16:38.293476 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a6d074-b79b-43ac-812e-5a9a4b0519f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a043a385f94e4aef84280c4a1533da28', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80319) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:16:38.294132 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d074-b79b-43ac-812e-5a9a4b0519f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:16:38.294412 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d074-b79b-43ac-812e-5a9a4b0519f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:16:38.294683 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a6d074-b79b-43ac-812e-5a9a4b0519f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80319) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:16:38.305047 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6d074-b79b-43ac-812e-5a9a4b0519f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:16:38.306608 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a6d074-b79b-43ac-812e-5a9a4b0519f7 service cinder] RBAC: Authorization granted {{(pid=80319) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:16:38.316923 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: [pid: 80319|app: 0|req: 986/1951] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:16:38 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:16:48.204233 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:INSERT=2,keystone:SELECT=39 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:16:48.312175 dv-cinder-852261-1-iscsi devstack@keystone.service[80319]: DEBUG dbcounter [-] [80319] Writing DB stats keystone:SELECT=48,keystone:INSERT=2 {{(pid=80319) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 08 01:19:56.919149 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] Authenticating user token {{(pid=80318) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 08 01:19:56.920844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:19:56.996618 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dbec4f-b585-4bb9-bc48-d46bd872b61a None None] Validating token access rules against request {{(pid=80318) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 08 01:19:57.002969 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c60924-daba-4fec-8e93-a2f4d8c3b53e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '14eeba99731f4c0f98ea78914f8ed697', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '527237e81fd44bf6b40ec462a0d6b829', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80318) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 08 01:19:57.003572 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60924-daba-4fec-8e93-a2f4d8c3b53e service placement] REQUEST_METHOD: `GET` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 08 01:19:57.003844 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60924-daba-4fec-8e93-a2f4d8c3b53e service placement] SCRIPT_NAME: `/identity` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 08 01:19:57.004108 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c60924-daba-4fec-8e93-a2f4d8c3b53e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80318) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 08 01:19:57.006161 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.fernet_utils [None req-b9c60924-daba-4fec-8e93-a2f4d8c3b53e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80318) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 08 01:19:57.018788 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60924-daba-4fec-8e93-a2f4d8c3b53e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 08 01:19:57.020369 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c60924-daba-4fec-8e93-a2f4d8c3b53e service placement] RBAC: Authorization granted {{(pid=80318) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 08 01:19:57.031125 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: [pid: 80318|app: 0|req: 966/1952] 10.222.0.39 () {60 vars in 1365 bytes} [Mon Aug 8 01:19:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 08 01:20:07.026984 dv-cinder-852261-1-iscsi devstack@keystone.service[80318]: DEBUG dbcounter [-] [80318] Writing DB stats keystone:SELECT=32 {{(pid=80318) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}